2023-07-20 23:10:13,770 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 23:10:14,022 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8 2023-07-20 23:10:14,023 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-20 23:10:14,070 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 23:10:14,325 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 23:10:14,326 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4, deleteOnExit=true 2023-07-20 23:10:14,326 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 23:10:14,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/test.cache.data in system properties and HBase conf 2023-07-20 23:10:14,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 23:10:14,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop.log.dir in system properties and HBase conf 2023-07-20 23:10:14,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 23:10:14,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 23:10:14,330 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 23:10:14,649 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 23:10:14,653 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:14,654 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:14,654 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 23:10:14,654 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:14,655 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 23:10:14,655 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 23:10:14,655 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:14,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:14,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 23:10:14,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/nfs.dump.dir in system properties and HBase conf 2023-07-20 23:10:14,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir in system properties and HBase conf 2023-07-20 23:10:14,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:14,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 23:10:14,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 23:10:15,306 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 23:10:15,310 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 23:10:15,598 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 23:10:15,764 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 23:10:15,777 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:15,826 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:15,865 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_localhost_35909_hdfs____ksyl8q/webapp 2023-07-20 23:10:16,040 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35909 2023-07-20 23:10:16,084 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 23:10:16,084 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 23:10:16,726 WARN [Listener at localhost/33785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:16,834 WARN [Listener at localhost/33785] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 23:10:16,861 WARN [Listener at localhost/33785] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:16,870 INFO [Listener at localhost/33785] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:16,880 INFO [Listener at localhost/33785] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_localhost_45779_datanode____.rs45pd/webapp 2023-07-20 23:10:17,023 INFO [Listener at localhost/33785] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45779 2023-07-20 23:10:17,576 WARN [Listener at localhost/35007] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:17,606 WARN [Listener at localhost/35007] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 23:10:17,613 WARN [Listener at localhost/35007] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:17,616 INFO [Listener at localhost/35007] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:17,625 INFO [Listener at localhost/35007] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_localhost_33529_datanode____tp220z/webapp 2023-07-20 23:10:17,737 INFO [Listener at localhost/35007] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33529 2023-07-20 23:10:17,754 WARN [Listener at localhost/39101] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:17,817 WARN [Listener at localhost/39101] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 23:10:17,823 WARN [Listener at localhost/39101] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:17,825 INFO [Listener at localhost/39101] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:17,830 INFO [Listener at localhost/39101] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_localhost_45535_datanode____.osi7kz/webapp 2023-07-20 23:10:17,984 INFO [Listener at localhost/39101] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45535 2023-07-20 23:10:18,005 WARN [Listener at localhost/42615] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:18,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93c3fe056c230844: Processing first storage report for DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc from datanode d47c2b68-5c85-4d8f-9dff-519aa096ec83 2023-07-20 23:10:18,404 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93c3fe056c230844: from storage DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc node DatanodeRegistration(127.0.0.1:44497, datanodeUuid=d47c2b68-5c85-4d8f-9dff-519aa096ec83, infoPort=37519, infoSecurePort=0, ipcPort=39101, storageInfo=lv=-57;cid=testClusterID;nsid=1392077347;c=1689894615380), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14f2771626d0a58e: Processing first storage report for DS-4455e3cd-7425-48a2-bb88-0c79918c54d9 from datanode 6c098bcf-888c-4c53-8fa0-765aa8dae29a 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14f2771626d0a58e: from storage DS-4455e3cd-7425-48a2-bb88-0c79918c54d9 node DatanodeRegistration(127.0.0.1:44005, datanodeUuid=6c098bcf-888c-4c53-8fa0-765aa8dae29a, infoPort=45627, infoSecurePort=0, ipcPort=42615, storageInfo=lv=-57;cid=testClusterID;nsid=1392077347;c=1689894615380), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbea1cc9c10125c09: Processing first storage report for DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9 from datanode 1035b865-a9e7-4629-9f26-e578ebc21c3e 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbea1cc9c10125c09: from storage DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9 node DatanodeRegistration(127.0.0.1:44665, datanodeUuid=1035b865-a9e7-4629-9f26-e578ebc21c3e, infoPort=34243, infoSecurePort=0, ipcPort=35007, storageInfo=lv=-57;cid=testClusterID;nsid=1392077347;c=1689894615380), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93c3fe056c230844: Processing first storage report for DS-94196032-94de-4373-a098-e07a0c020b07 from datanode d47c2b68-5c85-4d8f-9dff-519aa096ec83 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93c3fe056c230844: from storage DS-94196032-94de-4373-a098-e07a0c020b07 node DatanodeRegistration(127.0.0.1:44497, datanodeUuid=d47c2b68-5c85-4d8f-9dff-519aa096ec83, infoPort=37519, infoSecurePort=0, ipcPort=39101, storageInfo=lv=-57;cid=testClusterID;nsid=1392077347;c=1689894615380), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14f2771626d0a58e: Processing first storage report for DS-1dd4cbe3-997c-44ff-a5c4-9492b7d1db1e from datanode 6c098bcf-888c-4c53-8fa0-765aa8dae29a 2023-07-20 23:10:18,406 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14f2771626d0a58e: from storage DS-1dd4cbe3-997c-44ff-a5c4-9492b7d1db1e node DatanodeRegistration(127.0.0.1:44005, datanodeUuid=6c098bcf-888c-4c53-8fa0-765aa8dae29a, infoPort=45627, infoSecurePort=0, ipcPort=42615, storageInfo=lv=-57;cid=testClusterID;nsid=1392077347;c=1689894615380), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,406 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbea1cc9c10125c09: Processing first storage report for DS-cd44c560-b053-4912-9ed6-33ab01f50596 from datanode 1035b865-a9e7-4629-9f26-e578ebc21c3e 2023-07-20 23:10:18,406 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbea1cc9c10125c09: from storage DS-cd44c560-b053-4912-9ed6-33ab01f50596 node DatanodeRegistration(127.0.0.1:44665, datanodeUuid=1035b865-a9e7-4629-9f26-e578ebc21c3e, infoPort=34243, infoSecurePort=0, ipcPort=35007, storageInfo=lv=-57;cid=testClusterID;nsid=1392077347;c=1689894615380), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,620 DEBUG [Listener at localhost/42615] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8 2023-07-20 23:10:18,715 INFO [Listener at localhost/42615] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/zookeeper_0, clientPort=51258, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 23:10:18,740 INFO [Listener at localhost/42615] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51258 2023-07-20 23:10:18,752 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:18,754 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:19,485 INFO [Listener at localhost/42615] util.FSUtils(471): Created version file at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d with version=8 2023-07-20 23:10:19,486 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/hbase-staging 2023-07-20 23:10:19,856 INFO [Listener at localhost/42615] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 23:10:20,530 INFO [Listener at localhost/42615] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:20,583 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:20,584 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:20,584 INFO [Listener at localhost/42615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:20,585 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:20,585 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:20,783 INFO [Listener at localhost/42615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:20,866 DEBUG [Listener at localhost/42615] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 23:10:21,006 INFO [Listener at localhost/42615] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40207 2023-07-20 23:10:21,021 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,023 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,058 INFO [Listener at localhost/42615] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40207 connecting to ZooKeeper ensemble=127.0.0.1:51258 2023-07-20 23:10:21,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:402070x0, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40207-0x101850009440000 connected 2023-07-20 23:10:21,220 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,221 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,238 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,263 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40207 2023-07-20 23:10:21,263 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40207 2023-07-20 23:10:21,266 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40207 2023-07-20 23:10:21,271 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40207 2023-07-20 23:10:21,273 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40207 2023-07-20 23:10:21,282 INFO [Listener at localhost/42615] master.HMaster(444): hbase.rootdir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, hbase.cluster.distributed=false 2023-07-20 23:10:21,376 INFO [Listener at localhost/42615] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:21,376 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,376 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,377 INFO [Listener at localhost/42615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:21,377 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,377 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:21,385 INFO [Listener at localhost/42615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:21,389 INFO [Listener at localhost/42615] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46763 2023-07-20 23:10:21,393 INFO [Listener at localhost/42615] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 23:10:21,404 DEBUG [Listener at localhost/42615] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 23:10:21,406 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,409 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,413 INFO [Listener at localhost/42615] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46763 connecting to ZooKeeper ensemble=127.0.0.1:51258 2023-07-20 23:10:21,430 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:467630x0, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,432 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:467630x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,437 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:467630x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46763-0x101850009440001 connected 2023-07-20 23:10:21,439 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,443 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46763 2023-07-20 23:10:21,444 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46763 2023-07-20 23:10:21,445 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46763 2023-07-20 23:10:21,450 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46763 2023-07-20 23:10:21,450 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46763 2023-07-20 23:10:21,470 INFO [Listener at localhost/42615] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:21,470 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,471 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,471 INFO [Listener at localhost/42615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:21,471 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,472 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:21,472 INFO [Listener at localhost/42615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:21,474 INFO [Listener at localhost/42615] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45507 2023-07-20 23:10:21,475 INFO [Listener at localhost/42615] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 23:10:21,484 DEBUG [Listener at localhost/42615] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 23:10:21,486 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,489 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,491 INFO [Listener at localhost/42615] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45507 connecting to ZooKeeper ensemble=127.0.0.1:51258 2023-07-20 23:10:21,499 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:455070x0, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,501 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:455070x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,502 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:455070x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,504 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:455070x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45507-0x101850009440002 connected 2023-07-20 23:10:21,514 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45507 2023-07-20 23:10:21,518 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45507 2023-07-20 23:10:21,522 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45507 2023-07-20 23:10:21,525 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45507 2023-07-20 23:10:21,526 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45507 2023-07-20 23:10:21,544 INFO [Listener at localhost/42615] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:21,545 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,545 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,545 INFO [Listener at localhost/42615] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:21,545 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,545 INFO [Listener at localhost/42615] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:21,546 INFO [Listener at localhost/42615] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:21,547 INFO [Listener at localhost/42615] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45475 2023-07-20 23:10:21,548 INFO [Listener at localhost/42615] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 23:10:21,554 DEBUG [Listener at localhost/42615] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 23:10:21,556 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,560 INFO [Listener at localhost/42615] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,562 INFO [Listener at localhost/42615] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45475 connecting to ZooKeeper ensemble=127.0.0.1:51258 2023-07-20 23:10:21,570 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:454750x0, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,573 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:454750x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,574 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:454750x0, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45475-0x101850009440003 connected 2023-07-20 23:10:21,575 DEBUG [Listener at localhost/42615] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,583 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45475 2023-07-20 23:10:21,583 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45475 2023-07-20 23:10:21,587 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45475 2023-07-20 23:10:21,587 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45475 2023-07-20 23:10:21,588 DEBUG [Listener at localhost/42615] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45475 2023-07-20 23:10:21,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:21,605 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 23:10:21,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:21,632 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,632 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,632 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:21,632 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 23:10:21,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40207,1689894619668 from backup master directory 2023-07-20 23:10:21,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 23:10:21,643 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:21,644 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 23:10:21,645 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:21,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:21,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 23:10:21,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 23:10:21,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/hbase.id with ID: fd6ac20b-7659-4b07-8aad-7c3f66731860 2023-07-20 23:10:21,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,868 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:21,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x169fe17c to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:21,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11e564d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:22,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:22,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 23:10:22,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 23:10:22,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 23:10:22,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 23:10:22,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 23:10:22,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:22,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store-tmp 2023-07-20 23:10:22,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:22,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 23:10:22,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 23:10:22,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 23:10:22,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/WALs/jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:22,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40207%2C1689894619668, suffix=, logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/WALs/jenkins-hbase4.apache.org,40207,1689894619668, archiveDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/oldWALs, maxLogs=10 2023-07-20 23:10:22,248 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK] 2023-07-20 23:10:22,249 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK] 2023-07-20 23:10:22,248 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK] 2023-07-20 23:10:22,263 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 23:10:22,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/WALs/jenkins-hbase4.apache.org,40207,1689894619668/jenkins-hbase4.apache.org%2C40207%2C1689894619668.1689894622189 2023-07-20 23:10:22,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK], DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK], DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK]] 2023-07-20 23:10:22,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:22,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:22,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,494 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,502 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 23:10:22,536 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 23:10:22,552 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74608711, jitterRate=0.11175642907619476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:22,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 23:10:22,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 23:10:22,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 23:10:22,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 23:10:22,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 23:10:22,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 23:10:22,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 53 msec 2023-07-20 23:10:22,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 23:10:22,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 23:10:22,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 23:10:22,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 23:10:22,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 23:10:22,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 23:10:22,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 23:10:22,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 23:10:22,798 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 23:10:22,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 23:10:22,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 23:10:22,824 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,824 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,824 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,825 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,825 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40207,1689894619668, sessionid=0x101850009440000, setting cluster-up flag (Was=false) 2023-07-20 23:10:22,844 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 23:10:22,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:22,871 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 23:10:22,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:22,885 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp 2023-07-20 23:10:22,895 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(951): ClusterId : fd6ac20b-7659-4b07-8aad-7c3f66731860 2023-07-20 23:10:22,904 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(951): ClusterId : fd6ac20b-7659-4b07-8aad-7c3f66731860 2023-07-20 23:10:22,909 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 23:10:22,911 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 23:10:22,912 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(951): ClusterId : fd6ac20b-7659-4b07-8aad-7c3f66731860 2023-07-20 23:10:22,916 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 23:10:22,932 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 23:10:22,932 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 23:10:22,933 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 23:10:22,934 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 23:10:22,938 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 23:10:22,938 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 23:10:22,939 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 23:10:22,941 DEBUG [RS:0;jenkins-hbase4:46763] zookeeper.ReadOnlyZKClient(139): Connect 0x2104a1e3 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:22,941 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 23:10:22,943 DEBUG [RS:2;jenkins-hbase4:45475] zookeeper.ReadOnlyZKClient(139): Connect 0x65167251 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:22,945 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 23:10:22,952 DEBUG [RS:1;jenkins-hbase4:45507] zookeeper.ReadOnlyZKClient(139): Connect 0x15cedc5d to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:22,969 DEBUG [RS:2;jenkins-hbase4:45475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bd18083, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:22,969 DEBUG [RS:0;jenkins-hbase4:46763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d1191ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:22,970 DEBUG [RS:2;jenkins-hbase4:45475] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fee1921, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:10:22,971 DEBUG [RS:0;jenkins-hbase4:46763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67141b8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:10:22,999 DEBUG [RS:1;jenkins-hbase4:45507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b093094, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:22,999 DEBUG [RS:1;jenkins-hbase4:45507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f36b72d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:10:23,011 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45475 2023-07-20 23:10:23,011 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46763 2023-07-20 23:10:23,014 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45507 2023-07-20 23:10:23,022 INFO [RS:2;jenkins-hbase4:45475] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 23:10:23,023 INFO [RS:2;jenkins-hbase4:45475] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 23:10:23,031 INFO [RS:0;jenkins-hbase4:46763] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 23:10:23,032 INFO [RS:0;jenkins-hbase4:46763] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 23:10:23,031 INFO [RS:1;jenkins-hbase4:45507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 23:10:23,032 INFO [RS:1;jenkins-hbase4:45507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 23:10:23,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 23:10:23,043 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 23:10:23,043 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 23:10:23,044 INFO [RS:0;jenkins-hbase4:46763] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,050 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 23:10:23,050 INFO [RS:2;jenkins-hbase4:45475] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,051 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 23:10:23,050 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 23:10:23,044 INFO [RS:1;jenkins-hbase4:45507] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,052 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 23:10:23,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 23:10:23,055 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40207,1689894619668 with isa=jenkins-hbase4.apache.org/172.31.14.131:45507, startcode=1689894621469 2023-07-20 23:10:23,056 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40207,1689894619668 with isa=jenkins-hbase4.apache.org/172.31.14.131:46763, startcode=1689894621375 2023-07-20 23:10:23,055 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40207,1689894619668 with isa=jenkins-hbase4.apache.org/172.31.14.131:45475, startcode=1689894621544 2023-07-20 23:10:23,081 DEBUG [RS:0;jenkins-hbase4:46763] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 23:10:23,081 DEBUG [RS:2;jenkins-hbase4:45475] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 23:10:23,081 DEBUG [RS:1;jenkins-hbase4:45507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 23:10:23,163 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50237, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 23:10:23,163 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44605, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 23:10:23,167 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44629, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 23:10:23,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 23:10:23,178 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40207] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 23:10:23,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 23:10:23,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,190 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40207] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 23:10:23,191 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40207] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 23:10:23,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689894653200 2023-07-20 23:10:23,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 23:10:23,208 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 23:10:23,208 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 23:10:23,214 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:23,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 23:10:23,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 23:10:23,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 23:10:23,228 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 23:10:23,229 WARN [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 23:10:23,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 23:10:23,229 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 23:10:23,230 WARN [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 23:10:23,229 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 23:10:23,230 WARN [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 23:10:23,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 23:10:23,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 23:10:23,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 23:10:23,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 23:10:23,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 23:10:23,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 23:10:23,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689894623258,5,FailOnTimeoutGroup] 2023-07-20 23:10:23,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689894623259,5,FailOnTimeoutGroup] 2023-07-20 23:10:23,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 23:10:23,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,313 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:23,315 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:23,316 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:23,331 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40207,1689894619668 with isa=jenkins-hbase4.apache.org/172.31.14.131:45507, startcode=1689894621469 2023-07-20 23:10:23,331 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40207,1689894619668 with isa=jenkins-hbase4.apache.org/172.31.14.131:46763, startcode=1689894621375 2023-07-20 23:10:23,340 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40207,1689894619668 with isa=jenkins-hbase4.apache.org/172.31.14.131:45475, startcode=1689894621544 2023-07-20 23:10:23,356 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40207] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,362 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40207] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,363 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40207] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,399 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:23,399 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33785 2023-07-20 23:10:23,400 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 23:10:23,405 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:23,405 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33785 2023-07-20 23:10:23,405 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 23:10:23,405 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:23,405 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33785 2023-07-20 23:10:23,406 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 23:10:23,410 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:10:23,419 DEBUG [RS:1;jenkins-hbase4:45507] zookeeper.ZKUtil(162): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,419 DEBUG [RS:2;jenkins-hbase4:45475] zookeeper.ZKUtil(162): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,419 WARN [RS:1;jenkins-hbase4:45507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:23,421 INFO [RS:1;jenkins-hbase4:45507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:23,422 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,421 WARN [RS:2;jenkins-hbase4:45475] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:23,426 DEBUG [RS:0;jenkins-hbase4:46763] zookeeper.ZKUtil(162): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,426 WARN [RS:0;jenkins-hbase4:46763] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:23,423 INFO [RS:2;jenkins-hbase4:45475] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:23,429 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,426 INFO [RS:0;jenkins-hbase4:46763] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:23,429 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,431 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46763,1689894621375] 2023-07-20 23:10:23,432 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45475,1689894621544] 2023-07-20 23:10:23,432 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45507,1689894621469] 2023-07-20 23:10:23,457 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:23,462 DEBUG [RS:0;jenkins-hbase4:46763] zookeeper.ZKUtil(162): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,462 DEBUG [RS:2;jenkins-hbase4:45475] zookeeper.ZKUtil(162): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,463 DEBUG [RS:1;jenkins-hbase4:45507] zookeeper.ZKUtil(162): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,467 DEBUG [RS:0;jenkins-hbase4:46763] zookeeper.ZKUtil(162): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,467 DEBUG [RS:1;jenkins-hbase4:45507] zookeeper.ZKUtil(162): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 23:10:23,467 DEBUG [RS:2;jenkins-hbase4:45475] zookeeper.ZKUtil(162): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,468 DEBUG [RS:0;jenkins-hbase4:46763] zookeeper.ZKUtil(162): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,469 DEBUG [RS:1;jenkins-hbase4:45507] zookeeper.ZKUtil(162): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,469 DEBUG [RS:2;jenkins-hbase4:45475] zookeeper.ZKUtil(162): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,474 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/info 2023-07-20 23:10:23,475 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 23:10:23,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:23,477 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 23:10:23,486 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 23:10:23,487 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 23:10:23,490 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/rep_barrier 2023-07-20 23:10:23,491 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 23:10:23,492 DEBUG [RS:0;jenkins-hbase4:46763] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 23:10:23,494 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:23,495 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 23:10:23,507 INFO [RS:0;jenkins-hbase4:46763] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 23:10:23,508 INFO [RS:1;jenkins-hbase4:45507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 23:10:23,507 INFO [RS:2;jenkins-hbase4:45475] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 23:10:23,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/table 2023-07-20 23:10:23,524 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 23:10:23,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:23,538 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740 2023-07-20 23:10:23,539 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740 2023-07-20 23:10:23,545 INFO [RS:2;jenkins-hbase4:45475] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 23:10:23,551 INFO [RS:0;jenkins-hbase4:46763] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 23:10:23,553 INFO [RS:1;jenkins-hbase4:45507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 23:10:23,557 INFO [RS:0;jenkins-hbase4:46763] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 23:10:23,557 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,558 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 23:10:23,569 INFO [RS:1;jenkins-hbase4:45507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 23:10:23,559 INFO [RS:2;jenkins-hbase4:45475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 23:10:23,574 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,575 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 23:10:23,569 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,576 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 23:10:23,576 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 23:10:23,578 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 23:10:23,588 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:23,590 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66155748, jitterRate=-0.014202535152435303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 23:10:23,590 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,590 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,590 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 23:10:23,590 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,591 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 23:10:23,592 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 23:10:23,592 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 23:10:23,592 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 23:10:23,592 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 23:10:23,590 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,590 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,593 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,593 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,593 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,593 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,592 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,593 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,593 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,594 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:2;jenkins-hbase4:45475] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,594 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,595 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,595 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,596 DEBUG [RS:1;jenkins-hbase4:45507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,596 DEBUG [RS:0;jenkins-hbase4:46763] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,599 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 23:10:23,600 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 23:10:23,605 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 23:10:23,605 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 23:10:23,611 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,611 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,611 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,611 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,611 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,611 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,612 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,612 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,612 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 23:10:23,637 INFO [RS:0;jenkins-hbase4:46763] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 23:10:23,637 INFO [RS:2;jenkins-hbase4:45475] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 23:10:23,637 INFO [RS:1;jenkins-hbase4:45507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 23:10:23,641 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45475,1689894621544-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,641 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45507,1689894621469-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,641 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46763,1689894621375-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,654 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 23:10:23,658 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 23:10:23,671 INFO [RS:1;jenkins-hbase4:45507] regionserver.Replication(203): jenkins-hbase4.apache.org,45507,1689894621469 started 2023-07-20 23:10:23,671 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45507,1689894621469, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45507, sessionid=0x101850009440002 2023-07-20 23:10:23,671 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 23:10:23,671 INFO [RS:0;jenkins-hbase4:46763] regionserver.Replication(203): jenkins-hbase4.apache.org,46763,1689894621375 started 2023-07-20 23:10:23,671 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46763,1689894621375, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46763, sessionid=0x101850009440001 2023-07-20 23:10:23,671 DEBUG [RS:1;jenkins-hbase4:45507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,672 DEBUG [RS:1;jenkins-hbase4:45507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45507,1689894621469' 2023-07-20 23:10:23,672 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 23:10:23,672 INFO [RS:2;jenkins-hbase4:45475] regionserver.Replication(203): jenkins-hbase4.apache.org,45475,1689894621544 started 2023-07-20 23:10:23,672 DEBUG [RS:0;jenkins-hbase4:46763] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,672 DEBUG [RS:1;jenkins-hbase4:45507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 23:10:23,673 DEBUG [RS:0;jenkins-hbase4:46763] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46763,1689894621375' 2023-07-20 23:10:23,673 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45475,1689894621544, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45475, sessionid=0x101850009440003 2023-07-20 23:10:23,674 DEBUG [RS:0;jenkins-hbase4:46763] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 23:10:23,674 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 23:10:23,674 DEBUG [RS:2;jenkins-hbase4:45475] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,675 DEBUG [RS:2;jenkins-hbase4:45475] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45475,1689894621544' 2023-07-20 23:10:23,675 DEBUG [RS:2;jenkins-hbase4:45475] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 23:10:23,675 DEBUG [RS:0;jenkins-hbase4:46763] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 23:10:23,675 DEBUG [RS:1;jenkins-hbase4:45507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 23:10:23,676 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 23:10:23,676 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 23:10:23,676 DEBUG [RS:0;jenkins-hbase4:46763] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:23,676 DEBUG [RS:0;jenkins-hbase4:46763] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46763,1689894621375' 2023-07-20 23:10:23,676 DEBUG [RS:0;jenkins-hbase4:46763] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:23,676 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 23:10:23,676 DEBUG [RS:2;jenkins-hbase4:45475] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 23:10:23,677 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 23:10:23,677 DEBUG [RS:0;jenkins-hbase4:46763] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:23,677 DEBUG [RS:1;jenkins-hbase4:45507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:23,678 DEBUG [RS:1;jenkins-hbase4:45507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45507,1689894621469' 2023-07-20 23:10:23,678 DEBUG [RS:1;jenkins-hbase4:45507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:23,678 DEBUG [RS:0;jenkins-hbase4:46763] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 23:10:23,678 INFO [RS:0;jenkins-hbase4:46763] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 23:10:23,679 INFO [RS:0;jenkins-hbase4:46763] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 23:10:23,679 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 23:10:23,679 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 23:10:23,679 DEBUG [RS:1;jenkins-hbase4:45507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:23,679 DEBUG [RS:2;jenkins-hbase4:45475] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:23,679 DEBUG [RS:2;jenkins-hbase4:45475] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45475,1689894621544' 2023-07-20 23:10:23,679 DEBUG [RS:2;jenkins-hbase4:45475] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:23,680 DEBUG [RS:1;jenkins-hbase4:45507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 23:10:23,680 INFO [RS:1;jenkins-hbase4:45507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 23:10:23,680 DEBUG [RS:2;jenkins-hbase4:45475] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:23,680 INFO [RS:1;jenkins-hbase4:45507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 23:10:23,682 DEBUG [RS:2;jenkins-hbase4:45475] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 23:10:23,682 INFO [RS:2;jenkins-hbase4:45475] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 23:10:23,682 INFO [RS:2;jenkins-hbase4:45475] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 23:10:23,792 INFO [RS:1;jenkins-hbase4:45507] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45507%2C1689894621469, suffix=, logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45507,1689894621469, archiveDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs, maxLogs=32 2023-07-20 23:10:23,794 INFO [RS:0;jenkins-hbase4:46763] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46763%2C1689894621375, suffix=, logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,46763,1689894621375, archiveDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs, maxLogs=32 2023-07-20 23:10:23,795 INFO [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45475%2C1689894621544, suffix=, logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45475,1689894621544, archiveDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs, maxLogs=32 2023-07-20 23:10:23,811 DEBUG [jenkins-hbase4:40207] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 23:10:23,817 DEBUG [jenkins-hbase4:40207] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:23,850 DEBUG [jenkins-hbase4:40207] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:23,850 DEBUG [jenkins-hbase4:40207] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:23,850 DEBUG [jenkins-hbase4:40207] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:23,850 DEBUG [jenkins-hbase4:40207] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:23,860 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK] 2023-07-20 23:10:23,860 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK] 2023-07-20 23:10:23,860 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK] 2023-07-20 23:10:23,861 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45475,1689894621544, state=OPENING 2023-07-20 23:10:23,870 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK] 2023-07-20 23:10:23,870 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK] 2023-07-20 23:10:23,870 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK] 2023-07-20 23:10:23,872 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK] 2023-07-20 23:10:23,872 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK] 2023-07-20 23:10:23,872 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK] 2023-07-20 23:10:23,875 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 23:10:23,883 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:23,892 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 23:10:23,893 INFO [RS:0;jenkins-hbase4:46763] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,46763,1689894621375/jenkins-hbase4.apache.org%2C46763%2C1689894621375.1689894623796 2023-07-20 23:10:23,893 DEBUG [RS:0;jenkins-hbase4:46763] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK], DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK], DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK]] 2023-07-20 23:10:23,894 INFO [RS:1;jenkins-hbase4:45507] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45507,1689894621469/jenkins-hbase4.apache.org%2C45507%2C1689894621469.1689894623795 2023-07-20 23:10:23,895 DEBUG [RS:1;jenkins-hbase4:45507] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK], DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK], DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK]] 2023-07-20 23:10:23,899 INFO [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45475,1689894621544/jenkins-hbase4.apache.org%2C45475%2C1689894621544.1689894623797 2023-07-20 23:10:23,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:10:23,901 DEBUG [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK], DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK], DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK]] 2023-07-20 23:10:24,093 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:24,096 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:10:24,101 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:10:24,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 23:10:24,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:24,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45475%2C1689894621544.meta, suffix=.meta, logDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45475,1689894621544, archiveDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs, maxLogs=32 2023-07-20 23:10:24,169 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK] 2023-07-20 23:10:24,175 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK] 2023-07-20 23:10:24,185 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK] 2023-07-20 23:10:24,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/WALs/jenkins-hbase4.apache.org,45475,1689894621544/jenkins-hbase4.apache.org%2C45475%2C1689894621544.meta.1689894624121.meta 2023-07-20 23:10:24,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44005,DS-4455e3cd-7425-48a2-bb88-0c79918c54d9,DISK], DatanodeInfoWithStorage[127.0.0.1:44665,DS-c234f4d2-aa9d-4e81-a72f-67f8e4f0dcd9,DISK], DatanodeInfoWithStorage[127.0.0.1:44497,DS-a1ccc8c4-32ba-4d05-85c9-48d470eca2dc,DISK]] 2023-07-20 23:10:24,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:24,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 23:10:24,210 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:24,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 23:10:24,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 23:10:24,215 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 23:10:24,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 23:10:24,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:24,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 23:10:24,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 23:10:24,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 23:10:24,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/info 2023-07-20 23:10:24,251 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/info 2023-07-20 23:10:24,252 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 23:10:24,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:24,254 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 23:10:24,257 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/rep_barrier 2023-07-20 23:10:24,257 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/rep_barrier 2023-07-20 23:10:24,258 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 23:10:24,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:24,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 23:10:24,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/table 2023-07-20 23:10:24,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/table 2023-07-20 23:10:24,266 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 23:10:24,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:24,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740 2023-07-20 23:10:24,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740 2023-07-20 23:10:24,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 23:10:24,282 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 23:10:24,284 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70972388, jitterRate=0.05757099390029907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 23:10:24,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 23:10:24,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689894624084 2023-07-20 23:10:24,338 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45475,1689894621544, state=OPEN 2023-07-20 23:10:24,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 23:10:24,343 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 23:10:24,343 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 23:10:24,343 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 23:10:24,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 23:10:24,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45475,1689894621544 in 445 msec 2023-07-20 23:10:24,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 23:10:24,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 725 msec 2023-07-20 23:10:24,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3000 sec 2023-07-20 23:10:24,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689894624364, completionTime=-1 2023-07-20 23:10:24,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 23:10:24,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 23:10:24,450 DEBUG [hconnection-0x2ee570c2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:24,454 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:24,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 23:10:24,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689894684483 2023-07-20 23:10:24,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689894744483 2023-07-20 23:10:24,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 118 msec 2023-07-20 23:10:24,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40207,1689894619668-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40207,1689894619668-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40207,1689894619668-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40207, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,531 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 23:10:24,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 23:10:24,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:24,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 23:10:24,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:24,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:24,593 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:24,597 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8 empty. 2023-07-20 23:10:24,598 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:24,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 23:10:24,661 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:24,664 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 559280f842828188e4bcdf062a2dfcd8, NAME => 'hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:10:24,688 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:24,688 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 559280f842828188e4bcdf062a2dfcd8, disabling compactions & flushes 2023-07-20 23:10:24,689 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:24,689 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:24,689 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. after waiting 0 ms 2023-07-20 23:10:24,689 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:24,689 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:24,689 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 559280f842828188e4bcdf062a2dfcd8: 2023-07-20 23:10:24,695 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:24,715 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689894624699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894624699"}]},"ts":"1689894624699"} 2023-07-20 23:10:24,760 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 23:10:24,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:24,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894624763"}]},"ts":"1689894624763"} 2023-07-20 23:10:24,775 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 23:10:24,781 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:24,782 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:24,782 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:24,782 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:24,782 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:24,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=559280f842828188e4bcdf062a2dfcd8, ASSIGN}] 2023-07-20 23:10:24,788 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=559280f842828188e4bcdf062a2dfcd8, ASSIGN 2023-07-20 23:10:24,790 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=559280f842828188e4bcdf062a2dfcd8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45475,1689894621544; forceNewPlan=false, retain=false 2023-07-20 23:10:24,942 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 23:10:24,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=559280f842828188e4bcdf062a2dfcd8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:24,944 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689894624943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894624943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894624943"}]},"ts":"1689894624943"} 2023-07-20 23:10:24,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 559280f842828188e4bcdf062a2dfcd8, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:10:25,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:25,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 559280f842828188e4bcdf062a2dfcd8, NAME => 'hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:25,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. service=AccessControlService 2023-07-20 23:10:25,120 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:25,121 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,121 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:25,121 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,121 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,125 INFO [StoreOpener-559280f842828188e4bcdf062a2dfcd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,128 DEBUG [StoreOpener-559280f842828188e4bcdf062a2dfcd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/info 2023-07-20 23:10:25,128 DEBUG [StoreOpener-559280f842828188e4bcdf062a2dfcd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/info 2023-07-20 23:10:25,128 INFO [StoreOpener-559280f842828188e4bcdf062a2dfcd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 559280f842828188e4bcdf062a2dfcd8 columnFamilyName info 2023-07-20 23:10:25,130 INFO [StoreOpener-559280f842828188e4bcdf062a2dfcd8-1] regionserver.HStore(310): Store=559280f842828188e4bcdf062a2dfcd8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:25,132 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:10:25,150 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:25,152 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 559280f842828188e4bcdf062a2dfcd8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64312127, jitterRate=-0.04167462885379791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:25,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 559280f842828188e4bcdf062a2dfcd8: 2023-07-20 23:10:25,155 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8., pid=6, masterSystemTime=1689894625104 2023-07-20 23:10:25,159 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:25,160 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:10:25,161 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=559280f842828188e4bcdf062a2dfcd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:25,162 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689894625161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894625161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894625161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894625161"}]},"ts":"1689894625161"} 2023-07-20 23:10:25,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 23:10:25,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 559280f842828188e4bcdf062a2dfcd8, server=jenkins-hbase4.apache.org,45475,1689894621544 in 221 msec 2023-07-20 23:10:25,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 23:10:25,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=559280f842828188e4bcdf062a2dfcd8, ASSIGN in 393 msec 2023-07-20 23:10:25,189 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:25,189 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894625189"}]},"ts":"1689894625189"} 2023-07-20 23:10:25,193 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 23:10:25,198 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:25,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 653 msec 2023-07-20 23:10:25,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 23:10:25,264 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 23:10:25,264 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:25,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 23:10:25,320 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 23:10:25,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-20 23:10:25,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 23:10:25,349 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 23:10:25,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-20 23:10:25,364 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 23:10:25,368 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 23:10:25,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.723sec 2023-07-20 23:10:25,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 23:10:25,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 23:10:25,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 23:10:25,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40207,1689894619668-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 23:10:25,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40207,1689894619668-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 23:10:25,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:25,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 23:10:25,408 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:25,410 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:25,412 DEBUG [Listener at localhost/42615] zookeeper.ReadOnlyZKClient(139): Connect 0x0b7ca875 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:25,416 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/acl/0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 23:10:25,417 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/acl/0262943a33a8079e80aefcb02d76842b empty. 2023-07-20 23:10:25,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/acl/0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,420 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 23:10:25,424 DEBUG [Listener at localhost/42615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51a05794, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:25,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,446 DEBUG [hconnection-0x165d02e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:25,457 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:25,464 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0262943a33a8079e80aefcb02d76842b, NAME => 'hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:10:25,467 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:25,481 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:10:25,482 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 23:10:25,482 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/test.cache.data in system properties and HBase conf 2023-07-20 23:10:25,482 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 23:10:25,482 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop.log.dir in system properties and HBase conf 2023-07-20 23:10:25,483 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 23:10:25,483 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 23:10:25,483 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 23:10:25,483 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:25,484 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:25,484 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 23:10:25,484 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:25,485 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 23:10:25,485 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 23:10:25,485 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:25,485 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:25,486 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 23:10:25,486 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/nfs.dump.dir in system properties and HBase conf 2023-07-20 23:10:25,487 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir in system properties and HBase conf 2023-07-20 23:10:25,487 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:25,487 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 23:10:25,487 INFO [Listener at localhost/42615] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 23:10:25,491 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:25,491 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0262943a33a8079e80aefcb02d76842b, disabling compactions & flushes 2023-07-20 23:10:25,492 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,492 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,492 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. after waiting 0 ms 2023-07-20 23:10:25,492 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,492 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,492 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0262943a33a8079e80aefcb02d76842b: 2023-07-20 23:10:25,502 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:25,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689894625503"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894625503"}]},"ts":"1689894625503"} 2023-07-20 23:10:25,507 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 23:10:25,509 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:25,510 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894625510"}]},"ts":"1689894625510"} 2023-07-20 23:10:25,513 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 23:10:25,525 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:25,528 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:25,528 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:25,528 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:25,528 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:25,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0262943a33a8079e80aefcb02d76842b, ASSIGN}] 2023-07-20 23:10:25,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,534 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0262943a33a8079e80aefcb02d76842b, ASSIGN 2023-07-20 23:10:25,536 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0262943a33a8079e80aefcb02d76842b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:10:25,686 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 23:10:25,687 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0262943a33a8079e80aefcb02d76842b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:25,688 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689894625687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894625687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894625687"}]},"ts":"1689894625687"} 2023-07-20 23:10:25,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0262943a33a8079e80aefcb02d76842b, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:10:25,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,846 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:25,846 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:10:25,851 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:10:25,862 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0262943a33a8079e80aefcb02d76842b, NAME => 'hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:25,863 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. service=AccessControlService 2023-07-20 23:10:25,863 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:25,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:25,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,866 INFO [StoreOpener-0262943a33a8079e80aefcb02d76842b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,868 DEBUG [StoreOpener-0262943a33a8079e80aefcb02d76842b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/l 2023-07-20 23:10:25,868 DEBUG [StoreOpener-0262943a33a8079e80aefcb02d76842b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/l 2023-07-20 23:10:25,869 INFO [StoreOpener-0262943a33a8079e80aefcb02d76842b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0262943a33a8079e80aefcb02d76842b columnFamilyName l 2023-07-20 23:10:25,871 INFO [StoreOpener-0262943a33a8079e80aefcb02d76842b-1] regionserver.HStore(310): Store=0262943a33a8079e80aefcb02d76842b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:25,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,878 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,884 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:10:25,899 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:25,901 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0262943a33a8079e80aefcb02d76842b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74643020, jitterRate=0.11226767301559448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:25,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0262943a33a8079e80aefcb02d76842b: 2023-07-20 23:10:25,904 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b., pid=11, masterSystemTime=1689894625846 2023-07-20 23:10:25,919 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:10:25,922 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0262943a33a8079e80aefcb02d76842b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:25,922 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689894625922"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894625922"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894625922"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894625922"}]},"ts":"1689894625922"} 2023-07-20 23:10:25,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 23:10:25,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0262943a33a8079e80aefcb02d76842b, server=jenkins-hbase4.apache.org,45507,1689894621469 in 235 msec 2023-07-20 23:10:25,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 23:10:25,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0262943a33a8079e80aefcb02d76842b, ASSIGN in 402 msec 2023-07-20 23:10:25,936 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:25,936 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894625936"}]},"ts":"1689894625936"} 2023-07-20 23:10:25,938 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 23:10:25,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:25,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 540 msec 2023-07-20 23:10:26,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:26,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 23:10:26,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 23:10:26,838 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:27,130 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:27,137 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43005_jobhistory____.dgkydd/webapp 2023-07-20 23:10:27,307 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 23:10:27,307 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:27,307 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:27,310 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:27,386 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:27,670 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:28,086 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 23:10:28,140 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43005 2023-07-20 23:10:28,351 WARN [Listener at jenkins-hbase4.apache.org/43623] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:28,740 WARN [Listener at jenkins-hbase4.apache.org/43623] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 23:10:28,741 INFO [Listener at jenkins-hbase4.apache.org/43623] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:28,750 INFO [Listener at jenkins-hbase4.apache.org/43623] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33235_cluster____th7mgg/webapp 2023-07-20 23:10:28,849 INFO [Listener at jenkins-hbase4.apache.org/43623] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:28,849 INFO [Listener at jenkins-hbase4.apache.org/43623] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 23:10:28,849 INFO [Listener at jenkins-hbase4.apache.org/43623] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:28,850 INFO [Listener at jenkins-hbase4.apache.org/43623] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:28,861 INFO [Listener at jenkins-hbase4.apache.org/43623] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:29,150 INFO [Listener at jenkins-hbase4.apache.org/43623] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:29,441 INFO [Listener at jenkins-hbase4.apache.org/43623] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:29,489 INFO [Listener at jenkins-hbase4.apache.org/43623] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33235 2023-07-20 23:10:29,957 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:10:29,965 WARN [Listener at jenkins-hbase4.apache.org/43941] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:30,017 WARN [Listener at jenkins-hbase4.apache.org/43941] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 23:10:30,018 INFO [Listener at jenkins-hbase4.apache.org/43941] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:30,046 INFO [Listener at jenkins-hbase4.apache.org/43941] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38615_node____lvpxg3/webapp 2023-07-20 23:10:30,156 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 23:10:30,156 INFO [Listener at jenkins-hbase4.apache.org/43941] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 23:10:30,156 INFO [Listener at jenkins-hbase4.apache.org/43941] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:30,157 INFO [Listener at jenkins-hbase4.apache.org/43941] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:30,157 INFO [Listener at jenkins-hbase4.apache.org/43941] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:30,158 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 23:10:30,159 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 23:10:30,162 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:30,163 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 23:10:30,163 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:30,163 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 23:10:30,164 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 23:10:30,164 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 23:10:30,164 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:30,164 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 23:10:30,164 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 23:10:30,164 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 23:10:30,168 INFO [Listener at jenkins-hbase4.apache.org/43941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,198 INFO [Listener at jenkins-hbase4.apache.org/43941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,322 INFO [Listener at jenkins-hbase4.apache.org/43941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,341 INFO [Listener at jenkins-hbase4.apache.org/43941] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38615 2023-07-20 23:10:30,587 WARN [Listener at jenkins-hbase4.apache.org/36627] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:30,594 WARN [Listener at jenkins-hbase4.apache.org/36627] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 23:10:30,595 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:30,609 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35581_node____.1r0xi/webapp 2023-07-20 23:10:30,671 INFO [Listener at jenkins-hbase4.apache.org/36627] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 23:10:30,672 INFO [Listener at jenkins-hbase4.apache.org/36627] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:30,672 INFO [Listener at jenkins-hbase4.apache.org/36627] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:30,672 INFO [Listener at jenkins-hbase4.apache.org/36627] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:30,684 INFO [Listener at jenkins-hbase4.apache.org/36627] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,704 INFO [Listener at jenkins-hbase4.apache.org/36627] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,807 INFO [Listener at jenkins-hbase4.apache.org/36627] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,819 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35581 2023-07-20 23:10:30,853 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 23:10:30,855 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:30,943 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=173, AvailableMemoryMB=3066 2023-07-20 23:10:30,944 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-07-20 23:10:30,959 DEBUG [Listener at jenkins-hbase4.apache.org/36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 23:10:30,970 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 23:10:30,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:30,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:30,984 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:30,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 23:10:30,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:30,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:30,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:30,997 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:30,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e empty. 2023-07-20 23:10:31,000 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 empty. 2023-07-20 23:10:31,003 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,003 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,003 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 23:10:31,051 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:31,055 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e068f0966ae626d9b97efe3f01fc3d3e, NAME => 'testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:10:31,055 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2a09edf835ce982c8582556d6b82f3a4, NAME => 'testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:10:31,107 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,108 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2a09edf835ce982c8582556d6b82f3a4, disabling compactions & flushes 2023-07-20 23:10:31,108 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,108 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,108 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. after waiting 0 ms 2023-07-20 23:10:31,108 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:31,108 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2a09edf835ce982c8582556d6b82f3a4: 2023-07-20 23:10:31,115 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,116 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e068f0966ae626d9b97efe3f01fc3d3e, disabling compactions & flushes 2023-07-20 23:10:31,116 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,116 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,116 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. after waiting 0 ms 2023-07-20 23:10:31,116 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,116 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,116 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e068f0966ae626d9b97efe3f01fc3d3e: 2023-07-20 23:10:31,126 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:31,128 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894631127"}]},"ts":"1689894631127"} 2023-07-20 23:10:31,128 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894631127"}]},"ts":"1689894631127"} 2023-07-20 23:10:31,178 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:10:31,180 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:31,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894631180"}]},"ts":"1689894631180"} 2023-07-20 23:10:31,182 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 23:10:31,187 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:31,189 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:31,189 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:31,189 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:31,189 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:31,190 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, ASSIGN}] 2023-07-20 23:10:31,193 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, ASSIGN 2023-07-20 23:10:31,193 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, ASSIGN 2023-07-20 23:10:31,194 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:10:31,194 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46763,1689894621375; forceNewPlan=false, retain=false 2023-07-20 23:10:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:31,344 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:10:31,347 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2a09edf835ce982c8582556d6b82f3a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:31,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e068f0966ae626d9b97efe3f01fc3d3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:31,347 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894631347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894631347"}]},"ts":"1689894631347"} 2023-07-20 23:10:31,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894631347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894631347"}]},"ts":"1689894631347"} 2023-07-20 23:10:31,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 2a09edf835ce982c8582556d6b82f3a4, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:10:31,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e068f0966ae626d9b97efe3f01fc3d3e, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:10:31,509 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:31,510 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:10:31,516 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:10:31,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a09edf835ce982c8582556d6b82f3a4, NAME => 'testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:10:31,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. service=AccessControlService 2023-07-20 23:10:31,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:31,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e068f0966ae626d9b97efe3f01fc3d3e, NAME => 'testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:10:31,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. service=AccessControlService 2023-07-20 23:10:31,523 INFO [StoreOpener-2a09edf835ce982c8582556d6b82f3a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:31,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,527 DEBUG [StoreOpener-2a09edf835ce982c8582556d6b82f3a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf 2023-07-20 23:10:31,527 DEBUG [StoreOpener-2a09edf835ce982c8582556d6b82f3a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf 2023-07-20 23:10:31,528 INFO [StoreOpener-e068f0966ae626d9b97efe3f01fc3d3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,528 INFO [StoreOpener-2a09edf835ce982c8582556d6b82f3a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a09edf835ce982c8582556d6b82f3a4 columnFamilyName cf 2023-07-20 23:10:31,529 INFO [StoreOpener-2a09edf835ce982c8582556d6b82f3a4-1] regionserver.HStore(310): Store=2a09edf835ce982c8582556d6b82f3a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:31,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,532 DEBUG [StoreOpener-e068f0966ae626d9b97efe3f01fc3d3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf 2023-07-20 23:10:31,532 DEBUG [StoreOpener-e068f0966ae626d9b97efe3f01fc3d3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf 2023-07-20 23:10:31,533 INFO [StoreOpener-e068f0966ae626d9b97efe3f01fc3d3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e068f0966ae626d9b97efe3f01fc3d3e columnFamilyName cf 2023-07-20 23:10:31,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,534 INFO [StoreOpener-e068f0966ae626d9b97efe3f01fc3d3e-1] regionserver.HStore(310): Store=e068f0966ae626d9b97efe3f01fc3d3e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:31,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:31,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:31,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:31,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:31,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e068f0966ae626d9b97efe3f01fc3d3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71614189, jitterRate=0.06713457405567169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:31,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a09edf835ce982c8582556d6b82f3a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69484781, jitterRate=0.03540392220020294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:31,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e068f0966ae626d9b97efe3f01fc3d3e: 2023-07-20 23:10:31,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a09edf835ce982c8582556d6b82f3a4: 2023-07-20 23:10:31,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e., pid=16, masterSystemTime=1689894631509 2023-07-20 23:10:31,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4., pid=15, masterSystemTime=1689894631503 2023-07-20 23:10:31,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:31,575 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2a09edf835ce982c8582556d6b82f3a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:31,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,575 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894631575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894631575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894631575"}]},"ts":"1689894631575"} 2023-07-20 23:10:31,577 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e068f0966ae626d9b97efe3f01fc3d3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:31,577 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631577"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894631577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894631577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894631577"}]},"ts":"1689894631577"} 2023-07-20 23:10:31,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:31,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-20 23:10:31,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 2a09edf835ce982c8582556d6b82f3a4, server=jenkins-hbase4.apache.org,45507,1689894621469 in 232 msec 2023-07-20 23:10:31,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-20 23:10:31,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e068f0966ae626d9b97efe3f01fc3d3e, server=jenkins-hbase4.apache.org,46763,1689894621375 in 233 msec 2023-07-20 23:10:31,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, ASSIGN in 401 msec 2023-07-20 23:10:31,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-20 23:10:31,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, ASSIGN in 407 msec 2023-07-20 23:10:31,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:31,607 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894631607"}]},"ts":"1689894631607"} 2023-07-20 23:10:31,610 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 23:10:31,613 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:31,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:31,618 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 23:10:31,625 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:31,630 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:31,639 DEBUG [hconnection-0x24616553-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:31,643 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-20 23:10:31,653 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 23:10:31,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:31,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,698 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:31,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,698 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:31,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,699 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 721 msec 2023-07-20 23:10:32,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:32,116 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 23:10:32,116 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-20 23:10:32,117 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:32,123 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-20 23:10:32,124 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:32,124 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-20 23:10:32,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894632141 (current time:1689894632141). 2023-07-20 23:10:32,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:32,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x112b2d38 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52e8f05e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:32,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,153 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x112b2d38 to 127.0.0.1:51258 2023-07-20 23:10:32,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:32,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x07a035af to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:32,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f060e6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:32,268 DEBUG [hconnection-0x69a82dfa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,275 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,283 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07a035af to 127.0.0.1:51258 2023-07-20 23:10:32,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:32,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 23:10:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:32,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,343 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,345 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689895232345 2023-07-20 23:10:32,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 23:10:32,353 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,354 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:32,355 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:32,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 21 msec 2023-07-20 23:10:32,358 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,359 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689895232359 2023-07-20 23:10:32,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,399 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 23:10:32,399 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,401 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 23:10:32,401 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 23:10:32,402 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,402 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,407 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,407 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,407 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,407 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,408 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,408 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,409 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,409 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:32,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 23:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,417 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,416 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,421 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,421 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,421 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,422 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b665638[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:32,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b665638[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:32,430 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 23:10:32,430 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,433 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,434 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,434 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,434 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:10:32,434 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,435 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,435 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:32,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:32,435 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:32,435 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:32,436 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. started... 2023-07-20 23:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:32,438 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:32,438 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. started... 2023-07-20 23:10:32,440 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,440 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,440 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:32,442 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e068f0966ae626d9b97efe3f01fc3d3e: 2023-07-20 23:10:32,442 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a09edf835ce982c8582556d6b82f3a4: 2023-07-20 23:10:32,443 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,443 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,450 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:32,450 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:32,454 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:32,454 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:32,455 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:32,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:32,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:32,460 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:32,525 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. completed. 2023-07-20 23:10:32,525 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:10:32,529 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,529 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,529 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,529 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:10:32,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 23:10:32,660 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:32,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:32,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:32,662 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:10:32,925 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. completed. 2023-07-20 23:10:32,925 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:32,925 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:10:32,928 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,928 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,928 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,928 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:10:32,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 23:10:32,935 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 23:10:32,936 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:32,936 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:32,936 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,936 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:32,939 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,939 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,939 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,939 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,939 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,940 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,939 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,940 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,941 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,942 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,948 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,949 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,949 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,963 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:32,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:32,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:32,965 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:10:32,966 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,966 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,966 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,966 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,967 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,967 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,966 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,967 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,967 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,967 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,967 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,968 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,968 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:32,969 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,969 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:32,969 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:32,969 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,969 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:33,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:33,465 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:33,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:33,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:33,467 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-20 23:10:33,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 23:10:33,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:33,484 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:33,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689894632348Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689894632968 (+620 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689894632969 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689894632988 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689894633009 (+21 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689894633483 (+474 ms) 2023-07-20 23:10:33,487 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:33,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.1370 sec 2023-07-20 23:10:34,468 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:34,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:34,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:34,493 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:34,494 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:34,501 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:34,502 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:34,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46763] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:34,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:34,510 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 23:10:34,513 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:34,515 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:34,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:34,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894634546 (current time:1689894634546). 2023-07-20 23:10:34,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:34,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x395524c0 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:34,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44ff06c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:34,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:34,560 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:34,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x395524c0 to 127.0.0.1:51258 2023-07-20 23:10:34,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:34,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x376a24ec to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@278975e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:34,672 DEBUG [hconnection-0x1b7cbec0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:34,677 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:34,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:34,687 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:34,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x376a24ec to 127.0.0.1:51258 2023-07-20 23:10:34,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:34,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 23:10:34,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:34,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:34,696 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:34,699 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689895234699 2023-07-20 23:10:34,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 23:10:34,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:34,701 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:34,701 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:34,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:34,703 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:34,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-20 23:10:34,706 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:34,707 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689895234707 2023-07-20 23:10:34,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 23:10:34,733 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 23:10:34,733 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:34,734 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 23:10:34,734 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 23:10:34,735 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,735 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,737 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:34,737 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:34,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:34,737 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,737 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:34,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:34,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,738 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,738 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 23:10:34,739 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,739 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:34,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 23:10:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 23:10:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,741 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 23:10:34,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:34,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 23:10:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:34,742 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:34,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 23:10:34,748 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:34,748 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:34,748 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:34,748 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:34,750 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,750 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,749 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:34,751 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:34,752 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:34,752 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:34,752 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,752 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:34,755 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,756 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,756 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:34,762 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b11d0f6[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:34,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:34,771 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 23:10:34,771 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b11d0f6[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:34,777 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:34,778 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:34,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,777 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:10:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:34,778 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:34,779 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:34,779 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:34,779 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. started... 2023-07-20 23:10:34,779 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:34,779 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:34,779 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:34,778 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:34,779 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e068f0966ae626d9b97efe3f01fc3d3e 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-20 23:10:34,779 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. started... 2023-07-20 23:10:34,780 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a09edf835ce982c8582556d6b82f3a4 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-20 23:10:34,782 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:34,782 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:34,782 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:34,801 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:34,803 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:34,940 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/.tmp/cf/0e9bc68e70334d36b54962c01ac58f81 2023-07-20 23:10:34,957 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/.tmp/cf/4c93234dd293434ca200e44603fb171e 2023-07-20 23:10:35,004 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:35,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:35,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:35,008 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:10:35,010 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/.tmp/cf/4c93234dd293434ca200e44603fb171e as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf/4c93234dd293434ca200e44603fb171e 2023-07-20 23:10:35,011 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/.tmp/cf/0e9bc68e70334d36b54962c01ac58f81 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf/0e9bc68e70334d36b54962c01ac58f81 2023-07-20 23:10:35,021 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf/0e9bc68e70334d36b54962c01ac58f81, entries=44, sequenceid=6, filesize=7.8 K 2023-07-20 23:10:35,022 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf/4c93234dd293434ca200e44603fb171e, entries=6, sequenceid=6, filesize=5.2 K 2023-07-20 23:10:35,026 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 2a09edf835ce982c8582556d6b82f3a4 in 246ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:35,026 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 23:10:35,026 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e068f0966ae626d9b97efe3f01fc3d3e in 247ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:35,026 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 23:10:35,029 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e068f0966ae626d9b97efe3f01fc3d3e: 2023-07-20 23:10:35,029 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a09edf835ce982c8582556d6b82f3a4: 2023-07-20 23:10:35,029 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:35,029 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:35,029 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:35,030 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:35,030 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf/0e9bc68e70334d36b54962c01ac58f81] hfiles 2023-07-20 23:10:35,030 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf/4c93234dd293434ca200e44603fb171e] hfiles 2023-07-20 23:10:35,030 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf/0e9bc68e70334d36b54962c01ac58f81 for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:35,030 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf/4c93234dd293434ca200e44603fb171e for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:35,080 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. completed. 2023-07-20 23:10:35,080 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:10:35,084 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:35,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:10:35,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 23:10:35,308 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:35,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:35,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:35,311 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:10:35,481 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. completed. 2023-07-20 23:10:35,481 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:35,481 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:10:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:35,513 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:35,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,513 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:35,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:35,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:10:35,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 23:10:35,519 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 23:10:35,519 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:35,519 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:35,519 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 23:10:35,519 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:35,574 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,574 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:35,574 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,574 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:35,575 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:35,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:35,576 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:35,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:35,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:35,576 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:35,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,577 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:35,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,580 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,580 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:35,583 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:35,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:35,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:35,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 23:10:35,675 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:35,675 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:35,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:35,676 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:35,678 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:35,678 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,678 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:35,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:35,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:35,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:35,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 23:10:35,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,797 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 23:10:35,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689894634699Consolidate snapshot: snaptb0-testExportWithTargetName at 1689894635676 (+977 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689894635676Writing data manifest for snaptb0-testExportWithTargetName at 1689894635684 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689894635723 (+39 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689894635796 (+73 ms) 2023-07-20 23:10:35,799 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:35,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0990 sec 2023-07-20 23:10:35,811 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:35,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:35,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:35,814 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814 2023-07-20 23:10:35,815 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33785, tgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814, rawTgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:35,868 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:35,868 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1828538064_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 23:10:35,868 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 23:10:35,886 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 23:10:35,999 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,000 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,000 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,001 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,001 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,002 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,002 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,083 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-3109717708722550261.jar 2023-07-20 23:10:36,083 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,084 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,084 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,085 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,086 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,086 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:36,087 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:10:36,087 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:10:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:10:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:10:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:10:36,089 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:10:36,090 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:10:36,090 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:10:36,091 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:10:36,091 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:10:36,095 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:36,096 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:36,096 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:36,096 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:36,096 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:36,097 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:36,097 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:37,030 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:10:37,593 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:10:37,601 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 23:10:37,614 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 23:10:38,132 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:38,132 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:38,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:43,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:46,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:48,986 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:50,543 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:10:50,546 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:10:50,560 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 23:10:50,560 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:10:50,561 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:10:50,561 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 23:10:50,562 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 23:10:50,562 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 23:10:50,562 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814/.hbase-snapshot/testExportWithTargetName 2023-07-20 23:10:50,563 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 23:10:50,563 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894635814/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 23:10:50,575 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 23:10:50,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 23:10:50,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,597 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894650597"}]},"ts":"1689894650597"} 2023-07-20 23:10:50,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 23:10:50,599 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 23:10:50,601 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 23:10:50,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, UNASSIGN}] 2023-07-20 23:10:50,606 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, UNASSIGN 2023-07-20 23:10:50,607 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, UNASSIGN 2023-07-20 23:10:50,608 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2a09edf835ce982c8582556d6b82f3a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:50,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e068f0966ae626d9b97efe3f01fc3d3e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:50,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894650607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894650607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894650607"}]},"ts":"1689894650607"} 2023-07-20 23:10:50,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894650607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894650607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894650607"}]},"ts":"1689894650607"} 2023-07-20 23:10:50,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 2a09edf835ce982c8582556d6b82f3a4, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:10:50,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e068f0966ae626d9b97efe3f01fc3d3e, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:10:50,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 23:10:50,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:50,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a09edf835ce982c8582556d6b82f3a4, disabling compactions & flushes 2023-07-20 23:10:50,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e068f0966ae626d9b97efe3f01fc3d3e, disabling compactions & flushes 2023-07-20 23:10:50,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. after waiting 0 ms 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. after waiting 0 ms 2023-07-20 23:10:50,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:50,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:10:50,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:50,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4. 2023-07-20 23:10:50,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a09edf835ce982c8582556d6b82f3a4: 2023-07-20 23:10:50,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:10:50,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:50,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e. 2023-07-20 23:10:50,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e068f0966ae626d9b97efe3f01fc3d3e: 2023-07-20 23:10:50,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:50,815 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2a09edf835ce982c8582556d6b82f3a4, regionState=CLOSED 2023-07-20 23:10:50,816 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894650815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894650815"}]},"ts":"1689894650815"} 2023-07-20 23:10:50,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:50,817 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e068f0966ae626d9b97efe3f01fc3d3e, regionState=CLOSED 2023-07-20 23:10:50,817 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894650817"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894650817"}]},"ts":"1689894650817"} 2023-07-20 23:10:50,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-20 23:10:50,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 2a09edf835ce982c8582556d6b82f3a4, server=jenkins-hbase4.apache.org,45507,1689894621469 in 208 msec 2023-07-20 23:10:50,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-20 23:10:50,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e068f0966ae626d9b97efe3f01fc3d3e, server=jenkins-hbase4.apache.org,46763,1689894621375 in 206 msec 2023-07-20 23:10:50,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2a09edf835ce982c8582556d6b82f3a4, UNASSIGN in 219 msec 2023-07-20 23:10:50,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-20 23:10:50,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e068f0966ae626d9b97efe3f01fc3d3e, UNASSIGN in 221 msec 2023-07-20 23:10:50,828 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894650828"}]},"ts":"1689894650828"} 2023-07-20 23:10:50,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 23:10:50,832 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 23:10:50,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 248 msec 2023-07-20 23:10:50,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 23:10:50,902 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 23:10:50,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 23:10:50,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,917 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 23:10:50,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,923 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 23:10:50,925 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:50,925 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:50,927 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,927 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,927 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,927 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 23:10:50,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 23:10:50,927 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 23:10:50,928 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 23:10:50,928 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,928 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,929 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,929 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,929 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,928 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:50,929 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,929 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,929 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/recovered.edits] 2023-07-20 23:10:50,932 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/recovered.edits] 2023-07-20 23:10:50,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 23:10:50,938 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf/0e9bc68e70334d36b54962c01ac58f81 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/cf/0e9bc68e70334d36b54962c01ac58f81 2023-07-20 23:10:50,938 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf/4c93234dd293434ca200e44603fb171e to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/cf/4c93234dd293434ca200e44603fb171e 2023-07-20 23:10:50,943 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4/recovered.edits/9.seqid 2023-07-20 23:10:50,943 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e/recovered.edits/9.seqid 2023-07-20 23:10:50,943 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/2a09edf835ce982c8582556d6b82f3a4 2023-07-20 23:10:50,944 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportWithTargetName/e068f0966ae626d9b97efe3f01fc3d3e 2023-07-20 23:10:50,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 23:10:50,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,971 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 23:10:50,974 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 23:10:50,976 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,976 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 23:10:50,977 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894650976"}]},"ts":"9223372036854775807"} 2023-07-20 23:10:50,977 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894650976"}]},"ts":"9223372036854775807"} 2023-07-20 23:10:50,980 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:10:50,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e068f0966ae626d9b97efe3f01fc3d3e, NAME => 'testtb-testExportWithTargetName,,1689894630977.e068f0966ae626d9b97efe3f01fc3d3e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2a09edf835ce982c8582556d6b82f3a4, NAME => 'testtb-testExportWithTargetName,1,1689894630977.2a09edf835ce982c8582556d6b82f3a4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:10:50,980 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 23:10:50,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894650980"}]},"ts":"9223372036854775807"} 2023-07-20 23:10:50,986 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 23:10:50,989 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:50,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-07-20 23:10:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 23:10:51,034 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 23:10:51,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 23:10:51,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:51,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 23:10:51,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 23:10:51,106 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=759 (was 710) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:47080 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:54070 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:60048 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259767348_1 at /127.0.0.1:60150 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:42677 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259767348_1 at /127.0.0.1:52826 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:36311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=922 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 299), ProcessCount=181 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=1263 (was 3066) 2023-07-20 23:10:51,106 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-20 23:10:51,128 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=759, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=181, AvailableMemoryMB=1261 2023-07-20 23:10:51,129 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-20 23:10:51,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:51,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:10:51,137 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:51,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 23:10:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:51,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:51,142 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,142 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,143 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 empty. 2023-07-20 23:10:51,143 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f empty. 2023-07-20 23:10:51,143 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,143 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,143 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 23:10:51,171 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:51,173 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1cf670103af00ec53c44fa3d5b457ec7, NAME => 'testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:10:51,173 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b4b350f3fe8d787668ba92e104f8b05f, NAME => 'testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:10:51,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:51,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b4b350f3fe8d787668ba92e104f8b05f, disabling compactions & flushes 2023-07-20 23:10:51,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. after waiting 0 ms 2023-07-20 23:10:51,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b4b350f3fe8d787668ba92e104f8b05f: 2023-07-20 23:10:51,218 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:51,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1cf670103af00ec53c44fa3d5b457ec7, disabling compactions & flushes 2023-07-20 23:10:51,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. after waiting 0 ms 2023-07-20 23:10:51,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,219 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1cf670103af00ec53c44fa3d5b457ec7: 2023-07-20 23:10:51,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:51,228 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894651228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894651228"}]},"ts":"1689894651228"} 2023-07-20 23:10:51,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894651228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894651228"}]},"ts":"1689894651228"} 2023-07-20 23:10:51,232 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:10:51,233 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:51,233 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894651233"}]},"ts":"1689894651233"} 2023-07-20 23:10:51,235 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 23:10:51,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:51,240 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:51,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:51,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:51,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:51,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:51,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, ASSIGN}] 2023-07-20 23:10:51,260 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, ASSIGN 2023-07-20 23:10:51,261 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, ASSIGN 2023-07-20 23:10:51,262 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:10:51,264 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45475,1689894621544; forceNewPlan=false, retain=false 2023-07-20 23:10:51,413 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:10:51,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b4b350f3fe8d787668ba92e104f8b05f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,415 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1cf670103af00ec53c44fa3d5b457ec7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894651415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894651415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894651415"}]},"ts":"1689894651415"} 2023-07-20 23:10:51,416 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894651415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894651415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894651415"}]},"ts":"1689894651415"} 2023-07-20 23:10:51,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 1cf670103af00ec53c44fa3d5b457ec7, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:10:51,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure b4b350f3fe8d787668ba92e104f8b05f, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:10:51,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:51,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cf670103af00ec53c44fa3d5b457ec7, NAME => 'testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:10:51,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. service=AccessControlService 2023-07-20 23:10:51,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:51,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:51,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b4b350f3fe8d787668ba92e104f8b05f, NAME => 'testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:10:51,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. service=AccessControlService 2023-07-20 23:10:51,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:51,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:51,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,580 INFO [StoreOpener-1cf670103af00ec53c44fa3d5b457ec7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,581 INFO [StoreOpener-b4b350f3fe8d787668ba92e104f8b05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,581 DEBUG [StoreOpener-1cf670103af00ec53c44fa3d5b457ec7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf 2023-07-20 23:10:51,582 DEBUG [StoreOpener-1cf670103af00ec53c44fa3d5b457ec7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf 2023-07-20 23:10:51,582 INFO [StoreOpener-1cf670103af00ec53c44fa3d5b457ec7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cf670103af00ec53c44fa3d5b457ec7 columnFamilyName cf 2023-07-20 23:10:51,582 INFO [StoreOpener-1cf670103af00ec53c44fa3d5b457ec7-1] regionserver.HStore(310): Store=1cf670103af00ec53c44fa3d5b457ec7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:51,583 DEBUG [StoreOpener-b4b350f3fe8d787668ba92e104f8b05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf 2023-07-20 23:10:51,584 DEBUG [StoreOpener-b4b350f3fe8d787668ba92e104f8b05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf 2023-07-20 23:10:51,584 INFO [StoreOpener-b4b350f3fe8d787668ba92e104f8b05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4b350f3fe8d787668ba92e104f8b05f columnFamilyName cf 2023-07-20 23:10:51,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,585 INFO [StoreOpener-b4b350f3fe8d787668ba92e104f8b05f-1] regionserver.HStore(310): Store=b4b350f3fe8d787668ba92e104f8b05f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:51,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:10:51,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:10:51,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:51,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cf670103af00ec53c44fa3d5b457ec7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69995388, jitterRate=0.04301255941390991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:51,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cf670103af00ec53c44fa3d5b457ec7: 2023-07-20 23:10:51,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7., pid=30, masterSystemTime=1689894651570 2023-07-20 23:10:51,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:51,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b4b350f3fe8d787668ba92e104f8b05f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65978027, jitterRate=-0.016850784420967102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:51,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b4b350f3fe8d787668ba92e104f8b05f: 2023-07-20 23:10:51,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f., pid=31, masterSystemTime=1689894651571 2023-07-20 23:10:51,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,597 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1cf670103af00ec53c44fa3d5b457ec7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894651596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894651596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894651596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894651596"}]},"ts":"1689894651596"} 2023-07-20 23:10:51,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b4b350f3fe8d787668ba92e104f8b05f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894651598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894651598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894651598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894651598"}]},"ts":"1689894651598"} 2023-07-20 23:10:51,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-20 23:10:51,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 1cf670103af00ec53c44fa3d5b457ec7, server=jenkins-hbase4.apache.org,45507,1689894621469 in 181 msec 2023-07-20 23:10:51,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-20 23:10:51,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure b4b350f3fe8d787668ba92e104f8b05f, server=jenkins-hbase4.apache.org,45475,1689894621544 in 181 msec 2023-07-20 23:10:51,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, ASSIGN in 348 msec 2023-07-20 23:10:51,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-20 23:10:51,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, ASSIGN in 352 msec 2023-07-20 23:10:51,611 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:51,611 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894651611"}]},"ts":"1689894651611"} 2023-07-20 23:10:51,613 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 23:10:51,617 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:51,617 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 23:10:51,619 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:10:51,621 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:51,621 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:51,621 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:51,621 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:51,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:51,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:51,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:51,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:51,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 490 msec 2023-07-20 23:10:51,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:51,743 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 23:10:51,743 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-20 23:10:51,743 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:51,746 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-20 23:10:51,747 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:51,747 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-20 23:10:51,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:51,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894651752 (current time:1689894651752). 2023-07-20 23:10:51,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:51,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x4981da5c to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:51,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3563e341, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:51,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:51,763 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4981da5c to 127.0.0.1:51258 2023-07-20 23:10:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:51,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x1a81069a to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d157cac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:51,772 DEBUG [hconnection-0x77c6e5a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:51,773 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:51,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:51,778 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:51,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a81069a to 127.0.0.1:51258 2023-07-20 23:10:51,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:51,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:10:51,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:51,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:51,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:51,785 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:51,786 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895251786 2023-07-20 23:10:51,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 23:10:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:51,788 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:51,788 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:51,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:51,789 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:51,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-20 23:10:51,792 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:51,793 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895251793 2023-07-20 23:10:51,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,813 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 23:10:51,813 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,815 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 23:10:51,815 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:10:51,815 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,815 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,816 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,816 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,817 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,817 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,817 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,817 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,818 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:51,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:51,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,819 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:51,819 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 23:10:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,819 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:51,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:51,825 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,827 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:51,828 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:51,828 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:51,828 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:51,831 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,831 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,835 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,835 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,835 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,835 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,836 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:51,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a093e3a[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:51,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a093e3a[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:51,842 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:10:51,842 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:51,843 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,844 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:51,844 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:51,843 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:51,844 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,844 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,844 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:51,844 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:51,844 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:51,844 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. started... 2023-07-20 23:10:51,844 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,844 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. started... 2023-07-20 23:10:51,846 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cf670103af00ec53c44fa3d5b457ec7: 2023-07-20 23:10:51,846 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:51,846 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:51,846 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:10:51,847 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4b350f3fe8d787668ba92e104f8b05f: 2023-07-20 23:10:51,847 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,847 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:51,847 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:51,847 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,847 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:51,848 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,849 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:51,884 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. completed. 2023-07-20 23:10:51,884 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:51,884 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:51,884 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:51,884 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,884 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:51,884 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:10:51,887 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:51,887 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,887 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,887 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:51,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,889 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,889 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. completed. 2023-07-20 23:10:51,890 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:10:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:51,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:51,891 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:51,891 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,891 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:51,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,892 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,892 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:51,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:10:51,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:10:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45475,1689894621544': 2023-07-20 23:10:51,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:10:51,904 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 23:10:51,904 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:51,904 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:51,904 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,904 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:51,906 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,906 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,906 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,906 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,906 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,906 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,907 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,908 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,910 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,911 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,913 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,913 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,914 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,919 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,919 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:51,920 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,921 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,921 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,921 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,922 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,922 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:51,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:52,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 23:10:52,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:52,046 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:52,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689894651786Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689894651923 (+137 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689894651924 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689894651929 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689894651961 (+32 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689894652045 (+84 ms) 2023-07-20 23:10:52,049 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:52,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 262 msec 2023-07-20 23:10:52,091 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:52,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:52,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:52,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:52,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45475] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:52,112 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 23:10:52,112 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:52,114 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:52,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:52,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894652131 (current time:1689894652131). 2023-07-20 23:10:52,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:52,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x3720dbb0 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:52,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@777e75ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:52,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:52,145 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:52,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3720dbb0 to 127.0.0.1:51258 2023-07-20 23:10:52,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:52,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x36dd7e34 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:52,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c42a29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:52,166 DEBUG [hconnection-0x27e2a4f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:52,169 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:52,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:52,178 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:52,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36dd7e34 to 127.0.0.1:51258 2023-07-20 23:10:52,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:52,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:10:52,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:52,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:52,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:52,186 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:52,187 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895252187 2023-07-20 23:10:52,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:52,187 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 23:10:52,189 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:52,189 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:52,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:52,192 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:52,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-20 23:10:52,197 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:52,198 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895252198 2023-07-20 23:10:52,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 23:10:52,221 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 23:10:52,221 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:52,223 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 23:10:52,223 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:10:52,224 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,224 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,235 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:52,235 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:52,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:52,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:52,235 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:52,235 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:52,236 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,236 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,236 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,236 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:52,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:52,237 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:52,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 23:10:52,238 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:52,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 23:10:52,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 23:10:52,238 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:52,238 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:52,238 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:52,240 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:52,238 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:52,240 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:52,242 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:52,241 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:52,243 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:52,245 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,245 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,245 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:52,245 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,245 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,245 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,245 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:52,245 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,246 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:52,246 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,246 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63277cd5[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:52,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:52,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63277cd5[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:52,251 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:10:52,251 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:52,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,253 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:52,253 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:52,253 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:10:52,254 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,254 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:52,258 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:52,258 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:52,258 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:52,259 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. started... 2023-07-20 23:10:52,259 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1cf670103af00ec53c44fa3d5b457ec7 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 23:10:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:52,269 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:52,269 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. started... 2023-07-20 23:10:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:52,271 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b4b350f3fe8d787668ba92e104f8b05f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 23:10:52,290 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:52,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:52,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:52,292 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:52,324 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/.tmp/cf/c2f46448295b437e9d4465afdef8f0fc 2023-07-20 23:10:52,326 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/.tmp/cf/a05ff4c9f2c8417382bedad820c1483a 2023-07-20 23:10:52,347 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/.tmp/cf/a05ff4c9f2c8417382bedad820c1483a as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf/a05ff4c9f2c8417382bedad820c1483a 2023-07-20 23:10:52,347 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/.tmp/cf/c2f46448295b437e9d4465afdef8f0fc as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf/c2f46448295b437e9d4465afdef8f0fc 2023-07-20 23:10:52,359 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf/c2f46448295b437e9d4465afdef8f0fc, entries=47, sequenceid=6, filesize=8.0 K 2023-07-20 23:10:52,360 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b4b350f3fe8d787668ba92e104f8b05f in 90ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:52,361 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 23:10:52,361 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf/a05ff4c9f2c8417382bedad820c1483a, entries=3, sequenceid=6, filesize=5.0 K 2023-07-20 23:10:52,363 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b4b350f3fe8d787668ba92e104f8b05f: 2023-07-20 23:10:52,363 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:52,363 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:52,364 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf/c2f46448295b437e9d4465afdef8f0fc] hfiles 2023-07-20 23:10:52,364 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf/c2f46448295b437e9d4465afdef8f0fc for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:52,364 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 1cf670103af00ec53c44fa3d5b457ec7 in 105ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:52,366 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cf670103af00ec53c44fa3d5b457ec7: 2023-07-20 23:10:52,366 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:52,366 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:52,366 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf/a05ff4c9f2c8417382bedad820c1483a] hfiles 2023-07-20 23:10:52,367 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf/a05ff4c9f2c8417382bedad820c1483a for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:52,390 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. completed. 2023-07-20 23:10:52,390 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:10:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:52,391 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:10:52,397 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:52,397 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,397 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:52,397 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45475,1689894621544': 2023-07-20 23:10:52,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:10:52,492 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:52,494 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:10:52,789 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. completed. 2023-07-20 23:10:52,790 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:10:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:10:52,792 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:52,792 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,792 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:52,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:52,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:52,792 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:52,794 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:52,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:52,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:52,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:52,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,795 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:10:52,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:10:52,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:10:52,798 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 23:10:52,798 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:52,798 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:52,798 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 23:10:52,798 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:52,800 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:52,800 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:52,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:52,800 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,801 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:52,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,801 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:52,801 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,802 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:52,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:52,803 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,804 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,805 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:52,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:52,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:52,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:52,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:52,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 23:10:52,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:52,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:52,809 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,810 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,810 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:52,810 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:52,810 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:52,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:52,810 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:10:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:52,812 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,812 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:10:52,812 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:10:52,812 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,812 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 23:10:52,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,864 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:52,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689894652187Consolidate snapshot: snaptb0-testExportFileSystemState at 1689894652810 (+623 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689894652810Writing data manifest for snaptb0-testExportFileSystemState at 1689894652816 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689894652831 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689894652864 (+33 ms) 2023-07-20 23:10:52,867 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:52,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 678 msec 2023-07-20 23:10:53,295 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:53,298 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298 2023-07-20 23:10:53,299 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33785, tgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298, rawTgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:53,321 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:10:53,322 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_834077107_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:53,322 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 23:10:53,335 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:53,358 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,358 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,359 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,359 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,359 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,360 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,360 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,432 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-2933393851698352942.jar 2023-07-20 23:10:53,433 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,433 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,434 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,434 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,434 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,434 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:53,435 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:10:53,435 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:10:53,436 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:10:53,436 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:10:53,436 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:10:53,437 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:10:53,437 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:10:53,437 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:10:53,438 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:10:53,438 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:10:53,439 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:53,439 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:53,439 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:53,440 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:53,440 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:53,440 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:53,441 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:54,300 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:10:54,304 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 23:10:54,306 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 23:10:55,208 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:55,213 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:55,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:55,881 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0002_000001 (auth:SIMPLE) 2023-07-20 23:10:56,419 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:11:00,579 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:02,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:05,622 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:07,546 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:11:07,554 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:11:07,575 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 23:11:07,575 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:11:07,576 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:11:07,576 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 23:11:07,577 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 23:11:07,577 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 23:11:07,577 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 23:11:07,577 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 23:11:07,577 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894653298/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 23:11:07,586 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 23:11:07,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 23:11:07,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 23:11:07,593 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894667593"}]},"ts":"1689894667593"} 2023-07-20 23:11:07,595 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 23:11:07,597 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 23:11:07,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, UNASSIGN}] 2023-07-20 23:11:07,599 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, UNASSIGN 2023-07-20 23:11:07,600 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, UNASSIGN 2023-07-20 23:11:07,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1cf670103af00ec53c44fa3d5b457ec7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:07,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b4b350f3fe8d787668ba92e104f8b05f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:07,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894667601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894667601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894667601"}]},"ts":"1689894667601"} 2023-07-20 23:11:07,602 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894667601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894667601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894667601"}]},"ts":"1689894667601"} 2023-07-20 23:11:07,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 1cf670103af00ec53c44fa3d5b457ec7, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:11:07,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure b4b350f3fe8d787668ba92e104f8b05f, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:11:07,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 23:11:07,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:11:07,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cf670103af00ec53c44fa3d5b457ec7, disabling compactions & flushes 2023-07-20 23:11:07,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:11:07,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:11:07,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. after waiting 0 ms 2023-07-20 23:11:07,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:11:07,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:11:07,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b4b350f3fe8d787668ba92e104f8b05f, disabling compactions & flushes 2023-07-20 23:11:07,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:11:07,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:11:07,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. after waiting 0 ms 2023-07-20 23:11:07,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:11:07,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:07,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:07,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:07,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7. 2023-07-20 23:11:07,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cf670103af00ec53c44fa3d5b457ec7: 2023-07-20 23:11:07,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:07,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f. 2023-07-20 23:11:07,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b4b350f3fe8d787668ba92e104f8b05f: 2023-07-20 23:11:07,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:11:07,779 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1cf670103af00ec53c44fa3d5b457ec7, regionState=CLOSED 2023-07-20 23:11:07,779 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894667779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894667779"}]},"ts":"1689894667779"} 2023-07-20 23:11:07,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:11:07,779 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b4b350f3fe8d787668ba92e104f8b05f, regionState=CLOSED 2023-07-20 23:11:07,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894667779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894667779"}]},"ts":"1689894667779"} 2023-07-20 23:11:07,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-20 23:11:07,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 1cf670103af00ec53c44fa3d5b457ec7, server=jenkins-hbase4.apache.org,45507,1689894621469 in 177 msec 2023-07-20 23:11:07,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-20 23:11:07,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1cf670103af00ec53c44fa3d5b457ec7, UNASSIGN in 186 msec 2023-07-20 23:11:07,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure b4b350f3fe8d787668ba92e104f8b05f, server=jenkins-hbase4.apache.org,45475,1689894621544 in 178 msec 2023-07-20 23:11:07,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-20 23:11:07,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b4b350f3fe8d787668ba92e104f8b05f, UNASSIGN in 187 msec 2023-07-20 23:11:07,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894667787"}]},"ts":"1689894667787"} 2023-07-20 23:11:07,788 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 23:11:07,790 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 23:11:07,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-07-20 23:11:07,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 23:11:07,895 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 23:11:07,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 23:11:07,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,901 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 23:11:07,902 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,903 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 23:11:07,907 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,907 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,907 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,907 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:11:07,907 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:11:07,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:07,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:07,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:07,908 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:07,909 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:07,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-20 23:11:07,909 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:11:07,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 23:11:07,910 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/recovered.edits] 2023-07-20 23:11:07,910 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/recovered.edits] 2023-07-20 23:11:07,915 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf/a05ff4c9f2c8417382bedad820c1483a to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/cf/a05ff4c9f2c8417382bedad820c1483a 2023-07-20 23:11:07,915 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf/c2f46448295b437e9d4465afdef8f0fc to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/cf/c2f46448295b437e9d4465afdef8f0fc 2023-07-20 23:11:07,919 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7/recovered.edits/9.seqid 2023-07-20 23:11:07,919 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f/recovered.edits/9.seqid 2023-07-20 23:11:07,920 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/1cf670103af00ec53c44fa3d5b457ec7 2023-07-20 23:11:07,920 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemState/b4b350f3fe8d787668ba92e104f8b05f 2023-07-20 23:11:07,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 23:11:07,923 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,926 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 23:11:07,928 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 23:11:07,929 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,929 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 23:11:07,930 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894667929"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:07,930 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894667929"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:07,932 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:11:07,932 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1cf670103af00ec53c44fa3d5b457ec7, NAME => 'testtb-testExportFileSystemState,,1689894651130.1cf670103af00ec53c44fa3d5b457ec7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b4b350f3fe8d787668ba92e104f8b05f, NAME => 'testtb-testExportFileSystemState,1,1689894651130.b4b350f3fe8d787668ba92e104f8b05f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:11:07,932 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 23:11:07,932 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894667932"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:07,934 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 23:11:07,936 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:07,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 39 msec 2023-07-20 23:11:08,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 23:11:08,011 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 23:11:08,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 23:11:08,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 23:11:08,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 23:11:08,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 23:11:08,051 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=771 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:42392 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-601082702_1 at /127.0.0.1:36384 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1951 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:56506 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:35165 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-601082702_1 at /127.0.0.1:56476 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:36402 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 922) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 288), ProcessCount=181 (was 181), AvailableMemoryMB=1114 (was 1261) 2023-07-20 23:11:08,051 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=771 is superior to 500 2023-07-20 23:11:08,075 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=771, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=181, AvailableMemoryMB=1114 2023-07-20 23:11:08,075 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=771 is superior to 500 2023-07-20 23:11:08,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:11:08,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:08,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:11:08,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 23:11:08,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:08,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:11:08,087 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,090 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 empty. 2023-07-20 23:11:08,090 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,091 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,091 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 empty. 2023-07-20 23:11:08,091 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,092 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 23:11:08,119 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 23:11:08,120 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 23c36090f1fe1013709f0eb77820d317, NAME => 'testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:11:08,131 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 980891fb07492e659af6f7546419aa26, NAME => 'testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:11:08,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:08,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 23c36090f1fe1013709f0eb77820d317, disabling compactions & flushes 2023-07-20 23:11:08,159 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,159 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,160 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. after waiting 0 ms 2023-07-20 23:11:08,160 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,160 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,160 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 23c36090f1fe1013709f0eb77820d317: 2023-07-20 23:11:08,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:08,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 980891fb07492e659af6f7546419aa26, disabling compactions & flushes 2023-07-20 23:11:08,167 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. after waiting 0 ms 2023-07-20 23:11:08,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,167 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 980891fb07492e659af6f7546419aa26: 2023-07-20 23:11:08,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:11:08,172 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894668172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894668172"}]},"ts":"1689894668172"} 2023-07-20 23:11:08,172 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894668172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894668172"}]},"ts":"1689894668172"} 2023-07-20 23:11:08,175 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:11:08,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:11:08,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894668176"}]},"ts":"1689894668176"} 2023-07-20 23:11:08,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 23:11:08,181 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:11:08,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:11:08,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:11:08,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:11:08,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:11:08,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, ASSIGN}] 2023-07-20 23:11:08,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:08,187 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, ASSIGN 2023-07-20 23:11:08,187 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, ASSIGN 2023-07-20 23:11:08,189 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45475,1689894621544; forceNewPlan=false, retain=false 2023-07-20 23:11:08,189 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:11:08,339 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:11:08,342 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=980891fb07492e659af6f7546419aa26, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,342 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=23c36090f1fe1013709f0eb77820d317, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,342 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894668342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894668342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894668342"}]},"ts":"1689894668342"} 2023-07-20 23:11:08,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894668342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894668342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894668342"}]},"ts":"1689894668342"} 2023-07-20 23:11:08,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 23c36090f1fe1013709f0eb77820d317, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:11:08,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 980891fb07492e659af6f7546419aa26, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:11:08,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:08,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 23c36090f1fe1013709f0eb77820d317, NAME => 'testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:11:08,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. service=AccessControlService 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 980891fb07492e659af6f7546419aa26, NAME => 'testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:11:08,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. service=AccessControlService 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:08,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:08,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,503 INFO [StoreOpener-23c36090f1fe1013709f0eb77820d317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,503 INFO [StoreOpener-980891fb07492e659af6f7546419aa26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,504 DEBUG [StoreOpener-23c36090f1fe1013709f0eb77820d317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf 2023-07-20 23:11:08,504 DEBUG [StoreOpener-23c36090f1fe1013709f0eb77820d317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf 2023-07-20 23:11:08,504 DEBUG [StoreOpener-980891fb07492e659af6f7546419aa26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf 2023-07-20 23:11:08,504 DEBUG [StoreOpener-980891fb07492e659af6f7546419aa26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf 2023-07-20 23:11:08,505 INFO [StoreOpener-23c36090f1fe1013709f0eb77820d317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23c36090f1fe1013709f0eb77820d317 columnFamilyName cf 2023-07-20 23:11:08,505 INFO [StoreOpener-980891fb07492e659af6f7546419aa26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 980891fb07492e659af6f7546419aa26 columnFamilyName cf 2023-07-20 23:11:08,505 INFO [StoreOpener-23c36090f1fe1013709f0eb77820d317-1] regionserver.HStore(310): Store=23c36090f1fe1013709f0eb77820d317/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:08,505 INFO [StoreOpener-980891fb07492e659af6f7546419aa26-1] regionserver.HStore(310): Store=980891fb07492e659af6f7546419aa26/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:08,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:08,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:08,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:08,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:08,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 23c36090f1fe1013709f0eb77820d317; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61531361, jitterRate=-0.08311127126216888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:08,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 980891fb07492e659af6f7546419aa26; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66060994, jitterRate=-0.015614479780197144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:08,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 23c36090f1fe1013709f0eb77820d317: 2023-07-20 23:11:08,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 980891fb07492e659af6f7546419aa26: 2023-07-20 23:11:08,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26., pid=46, masterSystemTime=1689894668498 2023-07-20 23:11:08,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317., pid=45, masterSystemTime=1689894668496 2023-07-20 23:11:08,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,515 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=980891fb07492e659af6f7546419aa26, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,515 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894668515"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894668515"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894668515"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894668515"}]},"ts":"1689894668515"} 2023-07-20 23:11:08,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,516 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=23c36090f1fe1013709f0eb77820d317, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,516 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894668516"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894668516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894668516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894668516"}]},"ts":"1689894668516"} 2023-07-20 23:11:08,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-20 23:11:08,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 980891fb07492e659af6f7546419aa26, server=jenkins-hbase4.apache.org,45507,1689894621469 in 172 msec 2023-07-20 23:11:08,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-20 23:11:08,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 23c36090f1fe1013709f0eb77820d317, server=jenkins-hbase4.apache.org,45475,1689894621544 in 174 msec 2023-07-20 23:11:08,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, ASSIGN in 336 msec 2023-07-20 23:11:08,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-20 23:11:08,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, ASSIGN in 337 msec 2023-07-20 23:11:08,523 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:11:08,523 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894668523"}]},"ts":"1689894668523"} 2023-07-20 23:11:08,525 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 23:11:08,527 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:11:08,527 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 23:11:08,529 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 23:11:08,531 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:08,531 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:08,531 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:08,531 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:08,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:08,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:08,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:08,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:08,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 456 msec 2023-07-20 23:11:08,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:08,690 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 23:11:08,690 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-20 23:11:08,690 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:08,694 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-20 23:11:08,694 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:08,694 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-20 23:11:08,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:08,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894668697 (current time:1689894668697). 2023-07-20 23:11:08,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:08,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x11c5286e to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:08,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15acaf18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:08,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:08,716 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11c5286e to 127.0.0.1:51258 2023-07-20 23:11:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x3ac5407e to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:08,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fb8910, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:08,736 DEBUG [hconnection-0x725f3238-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:08,738 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:08,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:08,745 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:08,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ac5407e to 127.0.0.1:51258 2023-07-20 23:11:08,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:08,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 23:11:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:08,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:08,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:08,751 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:08,752 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689895268752 2023-07-20 23:11:08,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:08,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 23:11:08,753 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:08,754 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:08,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:08,756 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:08,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-20 23:11:08,759 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:08,759 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689895268759 2023-07-20 23:11:08,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,777 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 23:11:08,777 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:08,779 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 23:11:08,779 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 23:11:08,780 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,780 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,781 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,781 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,781 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,781 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,782 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,782 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 23:11:08,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,783 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,783 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,783 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:08,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,786 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:08,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,787 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:08,787 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:08,787 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:08,788 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:08,787 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:08,790 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:08,794 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:08,794 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:08,794 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:08,794 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,794 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,794 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:08,797 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,797 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,797 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,797 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56049627[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:08,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56049627[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:08,801 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 23:11:08,801 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,803 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:08,803 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:08,803 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:08,803 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,803 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:08,803 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:08,803 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. started... 2023-07-20 23:11:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,803 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,803 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,805 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:08,805 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 980891fb07492e659af6f7546419aa26: 2023-07-20 23:11:08,804 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. started... 2023-07-20 23:11:08,804 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:08,805 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:08,805 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:11:08,805 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,806 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:08,806 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23c36090f1fe1013709f0eb77820d317: 2023-07-20 23:11:08,806 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:08,807 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,807 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:08,807 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:08,811 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:08,811 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,811 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:08,837 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. completed. 2023-07-20 23:11:08,837 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:08,837 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:08,837 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:08,837 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:11:08,838 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. completed. 2023-07-20 23:11:08,838 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:08,838 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:11:08,843 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:08,843 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,843 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,843 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:08,845 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:08,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,845 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,845 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,845 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:08,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45475,1689894621544': 2023-07-20 23:11:08,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 23:11:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,854 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:11:08,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 23:11:08,854 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 23:11:08,854 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:08,854 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:08,854 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,854 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:08,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:08,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:08,855 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:08,856 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,856 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,857 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,857 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,856 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,857 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,858 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,860 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,860 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,860 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,864 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,867 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:08,867 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,867 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:08,867 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:08,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,867 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,867 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 23:11:08,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,922 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:08,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689894668752Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689894668865 (+113 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689894668866 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689894668871 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689894668881 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689894668922 (+41 ms) 2023-07-20 23:11:08,925 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:08,927 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 172 msec 2023-07-20 23:11:09,055 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:09,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:09,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:09,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45475] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:09,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:09,071 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 23:11:09,071 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:09,073 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:09,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:09,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894669085 (current time:1689894669085). 2023-07-20 23:11:09,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:09,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x5b372d7d to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:09,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@646c16e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:09,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:09,107 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b372d7d to 127.0.0.1:51258 2023-07-20 23:11:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x462175a2 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:09,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@249fe4de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:09,116 DEBUG [hconnection-0x20c03dbb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:09,117 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:09,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:09,124 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:09,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x462175a2 to 127.0.0.1:51258 2023-07-20 23:11:09,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:09,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 23:11:09,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:09,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:09,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:09,133 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:09,134 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689895269134 2023-07-20 23:11:09,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 23:11:09,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:09,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:09,141 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:09,141 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:09,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 13 msec 2023-07-20 23:11:09,150 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:09,155 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689895269155 2023-07-20 23:11:09,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 23:11:09,188 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 23:11:09,188 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:09,190 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 23:11:09,190 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 23:11:09,191 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,191 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,193 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:09,193 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:09,193 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:09,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:09,193 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:09,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,194 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,194 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,195 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,195 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 23:11:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 23:11:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:09,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 23:11:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:09,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 23:11:09,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 23:11:09,207 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:09,207 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:09,208 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:09,208 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:09,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 23:11:09,212 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:09,213 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:09,213 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:09,212 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:09,213 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:09,225 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:09,226 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,227 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:09,227 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,227 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:09,228 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,228 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:09,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:09,229 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,229 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:09,229 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:09,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:09,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:09,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a0b6da[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:09,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:09,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a0b6da[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:09,239 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 23:11:09,239 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,241 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,241 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,241 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:09,242 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:09,242 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:09,242 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,242 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:09,242 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:09,242 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:09,242 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,242 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. started... 2023-07-20 23:11:09,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,243 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:09,243 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:09,243 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:11:09,243 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 23c36090f1fe1013709f0eb77820d317 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 23:11:09,243 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,243 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:09,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:09,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:09,244 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:09,245 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:09,245 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:09,245 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:09,248 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:09,248 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:09,248 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:09,248 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. started... 2023-07-20 23:11:09,249 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 980891fb07492e659af6f7546419aa26 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 23:11:09,299 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/.tmp/cf/0c9292f020bd4db28745957f5a51ef3f 2023-07-20 23:11:09,302 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/.tmp/cf/524ca0dd02b7407f9cd0951dd97c69f9 2023-07-20 23:11:09,309 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/.tmp/cf/524ca0dd02b7407f9cd0951dd97c69f9 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf/524ca0dd02b7407f9cd0951dd97c69f9 2023-07-20 23:11:09,312 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/.tmp/cf/0c9292f020bd4db28745957f5a51ef3f as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf/0c9292f020bd4db28745957f5a51ef3f 2023-07-20 23:11:09,317 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf/524ca0dd02b7407f9cd0951dd97c69f9, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 23:11:09,319 INFO [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 23c36090f1fe1013709f0eb77820d317 in 76ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:09,319 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 23:11:09,319 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23c36090f1fe1013709f0eb77820d317: 2023-07-20 23:11:09,320 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:09,320 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:09,320 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf/524ca0dd02b7407f9cd0951dd97c69f9] hfiles 2023-07-20 23:11:09,320 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf/524ca0dd02b7407f9cd0951dd97c69f9 for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:09,323 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf/0c9292f020bd4db28745957f5a51ef3f, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 23:11:09,325 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 980891fb07492e659af6f7546419aa26 in 76ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:09,327 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 980891fb07492e659af6f7546419aa26: 2023-07-20 23:11:09,327 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:09,327 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:09,327 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf/0c9292f020bd4db28745957f5a51ef3f] hfiles 2023-07-20 23:11:09,327 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf/0c9292f020bd4db28745957f5a51ef3f for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:09,334 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. completed. 2023-07-20 23:11:09,334 DEBUG [rs(jenkins-hbase4.apache.org,45475,1689894621544)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:09,334 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:09,334 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:09,334 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,334 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:09,334 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:11:09,336 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:09,336 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,336 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:09,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:09,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:09,336 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:09,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:09,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:09,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:09,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45475,1689894621544': 2023-07-20 23:11:09,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 23:11:09,349 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. completed. 2023-07-20 23:11:09,349 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:09,349 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:11:09,350 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:09,350 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,350 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:09,350 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:09,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:09,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:09,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:11:09,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 23:11:09,357 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 23:11:09,357 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:09,357 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:09,357 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 23:11:09,357 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:09,364 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,364 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:09,364 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:09,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,364 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,365 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:09,365 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,366 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:09,366 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,372 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,372 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:09,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:09,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:09,376 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,376 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,377 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:09,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:09,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:09,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:09,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:09,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 23:11:09,384 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:09,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 23:11:09,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:09,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:09,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:09,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:09,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:09,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:09,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:09,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,444 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:09,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:09,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:09,446 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:11:09,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 23:11:09,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,471 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689894669134Consolidate snapshot: snaptb0-testConsecutiveExports at 1689894669384 (+250 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689894669384Writing data manifest for snaptb0-testConsecutiveExports at 1689894669401 (+17 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689894669428 (+27 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689894669470 (+42 ms) 2023-07-20 23:11:09,474 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:09,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 339 msec 2023-07-20 23:11:09,746 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:09,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:09,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:09,747 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747 2023-07-20 23:11:09,747 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:11:09,770 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:11:09,770 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@33b13f10, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,770 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 23:11:09,779 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:09,791 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,791 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,792 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,792 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,792 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,792 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,793 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,867 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-9167152672195704023.jar 2023-07-20 23:11:09,868 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,868 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,868 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,869 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,869 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,870 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:09,870 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:11:09,870 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:11:09,871 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:11:09,871 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:11:09,871 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:11:09,872 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:11:09,872 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:11:09,873 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:11:09,873 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:11:09,874 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:11:09,874 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:09,874 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:09,875 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:09,875 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:09,875 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:09,876 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:09,876 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:10,719 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:11:10,722 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 23:11:10,724 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 23:11:11,798 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:11,799 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:11,801 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:12,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:13,388 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:11:16,835 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:19,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:21,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:22,903 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:11:22,903 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:11:22,907 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 23:11:22,907 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:11:22,908 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:11:22,908 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,911 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:22,911 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:22,911 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2e2c172 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,911 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:22,911 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:22,913 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:11:22,942 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:11:22,942 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3fbb6042, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,942 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 23:11:22,958 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,971 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,972 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,972 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,973 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,973 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,973 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,974 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,058 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-5031980925782064678.jar 2023-07-20 23:11:23,059 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,059 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,060 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,060 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,060 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,061 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:23,061 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:11:23,061 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:11:23,062 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:11:23,062 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:11:23,063 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:11:23,063 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:11:23,063 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:11:23,064 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:11:23,064 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:11:23,065 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:11:23,065 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:23,066 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:23,067 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:23,067 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:23,067 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:23,068 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:23,068 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:23,523 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:11:23,525 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 23:11:23,528 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 23:11:27,893 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:27,893 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:27,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:28,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:33,347 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:35,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:38,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:39,760 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:11:39,760 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:11:39,777 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 23:11:39,777 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:11:39,777 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:11:39,778 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:39,784 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:39,785 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:39,785 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2e2c172 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:39,785 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:39,785 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/local-export-1689894669747/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:39,805 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 23:11:39,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 23:11:39,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:39,813 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894699813"}]},"ts":"1689894699813"} 2023-07-20 23:11:39,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 23:11:39,821 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 23:11:39,823 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 23:11:39,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, UNASSIGN}] 2023-07-20 23:11:39,828 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, UNASSIGN 2023-07-20 23:11:39,828 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, UNASSIGN 2023-07-20 23:11:39,829 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=23c36090f1fe1013709f0eb77820d317, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:39,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=980891fb07492e659af6f7546419aa26, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:39,830 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894699829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894699829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894699829"}]},"ts":"1689894699829"} 2023-07-20 23:11:39,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894699829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894699829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894699829"}]},"ts":"1689894699829"} 2023-07-20 23:11:39,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 23c36090f1fe1013709f0eb77820d317, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:11:39,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 980891fb07492e659af6f7546419aa26, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:11:39,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 23:11:39,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:39,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:39,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 980891fb07492e659af6f7546419aa26, disabling compactions & flushes 2023-07-20 23:11:39,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:39,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 23c36090f1fe1013709f0eb77820d317, disabling compactions & flushes 2023-07-20 23:11:39,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:39,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:39,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. after waiting 0 ms 2023-07-20 23:11:39,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:39,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:39,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. after waiting 0 ms 2023-07-20 23:11:39,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:40,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:40,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:40,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26. 2023-07-20 23:11:40,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 980891fb07492e659af6f7546419aa26: 2023-07-20 23:11:40,036 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=980891fb07492e659af6f7546419aa26, regionState=CLOSED 2023-07-20 23:11:40,036 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894700036"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894700036"}]},"ts":"1689894700036"} 2023-07-20 23:11:40,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 980891fb07492e659af6f7546419aa26 2023-07-20 23:11:40,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:40,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:40,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317. 2023-07-20 23:11:40,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 23c36090f1fe1013709f0eb77820d317: 2023-07-20 23:11:40,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-20 23:11:40,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 980891fb07492e659af6f7546419aa26, server=jenkins-hbase4.apache.org,45507,1689894621469 in 204 msec 2023-07-20 23:11:40,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:40,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=980891fb07492e659af6f7546419aa26, UNASSIGN in 222 msec 2023-07-20 23:11:40,048 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=23c36090f1fe1013709f0eb77820d317, regionState=CLOSED 2023-07-20 23:11:40,048 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894700048"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894700048"}]},"ts":"1689894700048"} 2023-07-20 23:11:40,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-20 23:11:40,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 23c36090f1fe1013709f0eb77820d317, server=jenkins-hbase4.apache.org,45475,1689894621544 in 218 msec 2023-07-20 23:11:40,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-20 23:11:40,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=23c36090f1fe1013709f0eb77820d317, UNASSIGN in 229 msec 2023-07-20 23:11:40,056 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894700056"}]},"ts":"1689894700056"} 2023-07-20 23:11:40,057 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 23:11:40,060 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 23:11:40,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 255 msec 2023-07-20 23:11:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 23:11:40,117 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 23:11:40,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 23:11:40,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:40,122 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:40,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 23:11:40,124 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:40,127 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 23:11:40,131 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,131 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,131 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,131 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:40,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 23:11:40,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 23:11:40,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 23:11:40,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,139 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 2023-07-20 23:11:40,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 23:11:40,140 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/recovered.edits] 2023-07-20 23:11:40,142 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/recovered.edits] 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:40,144 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,143 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 23:11:40,148 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf/524ca0dd02b7407f9cd0951dd97c69f9 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/cf/524ca0dd02b7407f9cd0951dd97c69f9 2023-07-20 23:11:40,152 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317/recovered.edits/9.seqid 2023-07-20 23:11:40,153 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/23c36090f1fe1013709f0eb77820d317 2023-07-20 23:11:40,155 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf/0c9292f020bd4db28745957f5a51ef3f to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/cf/0c9292f020bd4db28745957f5a51ef3f 2023-07-20 23:11:40,159 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26/recovered.edits/9.seqid 2023-07-20 23:11:40,163 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testConsecutiveExports/980891fb07492e659af6f7546419aa26 2023-07-20 23:11:40,163 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 23:11:40,166 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:40,169 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 23:11:40,172 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 23:11:40,173 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:40,173 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 23:11:40,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894700173"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:40,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894700173"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:40,183 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:11:40,183 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 23c36090f1fe1013709f0eb77820d317, NAME => 'testtb-testConsecutiveExports,,1689894668077.23c36090f1fe1013709f0eb77820d317.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 980891fb07492e659af6f7546419aa26, NAME => 'testtb-testConsecutiveExports,1,1689894668077.980891fb07492e659af6f7546419aa26.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:11:40,183 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 23:11:40,184 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894700183"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:40,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 23:11:40,190 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:40,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 71 msec 2023-07-20 23:11:40,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 23:11:40,246 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 23:11:40,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 23:11:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:40,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 23:11:40,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 23:11:40,327 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 771), OpenFileDescriptor=894 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 273) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=1325 (was 1114) - AvailableMemoryMB LEAK? - 2023-07-20 23:11:40,327 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-20 23:11:40,359 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=183, AvailableMemoryMB=1323 2023-07-20 23:11:40,359 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-20 23:11:40,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:11:40,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:11:40,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 23:11:40,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:40,370 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:11:40,374 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,374 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,374 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 empty. 2023-07-20 23:11:40,375 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,375 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 empty. 2023-07-20 23:11:40,376 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 23:11:40,417 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 23:11:40,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0c86c11e90b967808f5455a95c942434, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:11:40,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d0f50e9275d659a23c6b12af8814e93, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:11:40,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:40,495 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:40,495 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0c86c11e90b967808f5455a95c942434, disabling compactions & flushes 2023-07-20 23:11:40,495 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,495 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,495 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. after waiting 0 ms 2023-07-20 23:11:40,495 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,495 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,496 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0c86c11e90b967808f5455a95c942434: 2023-07-20 23:11:40,508 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:40,508 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2d0f50e9275d659a23c6b12af8814e93, disabling compactions & flushes 2023-07-20 23:11:40,509 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,509 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,509 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. after waiting 0 ms 2023-07-20 23:11:40,509 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,509 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,509 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2d0f50e9275d659a23c6b12af8814e93: 2023-07-20 23:11:40,514 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:11:40,517 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894700516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894700516"}]},"ts":"1689894700516"} 2023-07-20 23:11:40,517 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894700516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894700516"}]},"ts":"1689894700516"} 2023-07-20 23:11:40,535 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:11:40,537 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:11:40,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894700537"}]},"ts":"1689894700537"} 2023-07-20 23:11:40,543 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 23:11:40,548 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:11:40,550 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:11:40,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:11:40,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:11:40,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:11:40,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, ASSIGN}] 2023-07-20 23:11:40,554 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, ASSIGN 2023-07-20 23:11:40,555 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, ASSIGN 2023-07-20 23:11:40,556 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46763,1689894621375; forceNewPlan=false, retain=false 2023-07-20 23:11:40,556 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:11:40,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:40,706 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:11:40,709 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0c86c11e90b967808f5455a95c942434, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:40,709 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2d0f50e9275d659a23c6b12af8814e93, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:40,709 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894700709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894700709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894700709"}]},"ts":"1689894700709"} 2023-07-20 23:11:40,709 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894700709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894700709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894700709"}]},"ts":"1689894700709"} 2023-07-20 23:11:40,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 0c86c11e90b967808f5455a95c942434, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:11:40,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 2d0f50e9275d659a23c6b12af8814e93, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:11:40,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c86c11e90b967808f5455a95c942434, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:11:40,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. service=AccessControlService 2023-07-20 23:11:40,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:40,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:40,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,876 INFO [StoreOpener-0c86c11e90b967808f5455a95c942434-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d0f50e9275d659a23c6b12af8814e93, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:11:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. service=AccessControlService 2023-07-20 23:11:40,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,879 DEBUG [StoreOpener-0c86c11e90b967808f5455a95c942434-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf 2023-07-20 23:11:40,879 DEBUG [StoreOpener-0c86c11e90b967808f5455a95c942434-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf 2023-07-20 23:11:40,880 INFO [StoreOpener-0c86c11e90b967808f5455a95c942434-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c86c11e90b967808f5455a95c942434 columnFamilyName cf 2023-07-20 23:11:40,881 INFO [StoreOpener-0c86c11e90b967808f5455a95c942434-1] regionserver.HStore(310): Store=0c86c11e90b967808f5455a95c942434/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:40,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c86c11e90b967808f5455a95c942434 2023-07-20 23:11:40,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:40,887 INFO [StoreOpener-2d0f50e9275d659a23c6b12af8814e93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c86c11e90b967808f5455a95c942434; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66202818, jitterRate=-0.013501137495040894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:40,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c86c11e90b967808f5455a95c942434: 2023-07-20 23:11:40,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434., pid=60, masterSystemTime=1689894700863 2023-07-20 23:11:40,889 DEBUG [StoreOpener-2d0f50e9275d659a23c6b12af8814e93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf 2023-07-20 23:11:40,889 DEBUG [StoreOpener-2d0f50e9275d659a23c6b12af8814e93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf 2023-07-20 23:11:40,889 INFO [StoreOpener-2d0f50e9275d659a23c6b12af8814e93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d0f50e9275d659a23c6b12af8814e93 columnFamilyName cf 2023-07-20 23:11:40,890 INFO [StoreOpener-2d0f50e9275d659a23c6b12af8814e93-1] regionserver.HStore(310): Store=2d0f50e9275d659a23c6b12af8814e93/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:40,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:40,892 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0c86c11e90b967808f5455a95c942434, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:40,892 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894700892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894700892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894700892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894700892"}]},"ts":"1689894700892"} 2023-07-20 23:11:40,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-20 23:11:40,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 0c86c11e90b967808f5455a95c942434, server=jenkins-hbase4.apache.org,45507,1689894621469 in 183 msec 2023-07-20 23:11:40,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, ASSIGN in 349 msec 2023-07-20 23:11:40,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:11:40,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:40,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d0f50e9275d659a23c6b12af8814e93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64198100, jitterRate=-0.04337376356124878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:40,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d0f50e9275d659a23c6b12af8814e93: 2023-07-20 23:11:40,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93., pid=61, masterSystemTime=1689894700864 2023-07-20 23:11:40,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:40,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2d0f50e9275d659a23c6b12af8814e93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:40,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894700940"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894700940"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894700940"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894700940"}]},"ts":"1689894700940"} 2023-07-20 23:11:40,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-20 23:11:40,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 2d0f50e9275d659a23c6b12af8814e93, server=jenkins-hbase4.apache.org,46763,1689894621375 in 230 msec 2023-07-20 23:11:40,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-20 23:11:40,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, ASSIGN in 393 msec 2023-07-20 23:11:40,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:11:40,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894700947"}]},"ts":"1689894700947"} 2023-07-20 23:11:40,949 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 23:11:40,954 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:11:40,955 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 23:11:40,959 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 23:11:40,960 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,961 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,961 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,961 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:40,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:40,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:40,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:40,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:40,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 605 msec 2023-07-20 23:11:40,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:40,974 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 23:11:40,974 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-20 23:11:40,975 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:40,980 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-20 23:11:40,980 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:40,980 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-20 23:11:41,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894701016 (current time:1689894701016). 2023-07-20 23:11:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x3d869d2b to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:41,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15778c6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:41,038 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d869d2b to 127.0.0.1:51258 2023-07-20 23:11:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x4efdda9a to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:41,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@479b69ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:41,054 DEBUG [hconnection-0x6e2681d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:41,058 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:41,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:41,068 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:41,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4efdda9a to 127.0.0.1:51258 2023-07-20 23:11:41,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:41,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 23:11:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:41,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:41,075 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:41,079 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689895301079 2023-07-20 23:11:41,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:41,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,079 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:41,080 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:41,088 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:41,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:41,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-20 23:11:41,091 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:41,092 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689895301092 2023-07-20 23:11:41,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,105 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 23:11:41,105 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,107 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 23:11:41,107 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 23:11:41,108 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,108 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,109 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,109 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,109 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,109 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,110 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,110 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,110 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,111 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,111 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:41,112 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 23:11:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,113 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:41,113 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:41,113 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:41,113 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:41,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,113 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:41,114 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,115 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:41,115 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:41,115 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:41,115 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,115 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:41,120 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:41,120 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:41,120 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,123 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,124 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310bbc5a[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:41,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310bbc5a[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:41,128 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 23:11:41,128 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,129 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,129 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,129 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:41,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,130 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:41,130 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:11:41,130 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,130 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:41,130 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:41,130 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. started... 2023-07-20 23:11:41,130 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. started... 2023-07-20 23:11:41,132 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d0f50e9275d659a23c6b12af8814e93: 2023-07-20 23:11:41,132 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c86c11e90b967808f5455a95c942434: 2023-07-20 23:11:41,132 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,133 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:41,133 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,133 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:41,133 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:41,133 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:41,160 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. completed. 2023-07-20 23:11:41,160 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:41,160 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:11:41,162 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,162 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,162 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:41,162 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,169 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. completed. 2023-07-20 23:11:41,169 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:41,169 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:41,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,169 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:41,169 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,169 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:41,169 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:11:41,171 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,171 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:41,171 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:41,171 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:41,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:11:41,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 23:11:41,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:11:41,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 23:11:41,177 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 23:11:41,177 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:41,177 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:41,177 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,177 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,180 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,179 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:41,180 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:41,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:41,180 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:41,180 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:41,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,182 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,183 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,183 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,184 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,189 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,189 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,189 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,189 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,189 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:41,190 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:41,190 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:41,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-20 23:11:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:41,192 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,192 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,193 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,193 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,193 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:41,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 23:11:41,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,283 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689894701079Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894701192 (+113 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894701192Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894701203 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894701231 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689894701283 (+52 ms) 2023-07-20 23:11:41,286 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:41,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 201 msec 2023-07-20 23:11:41,382 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:41,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:41,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:41,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46763] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:41,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:41,505 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,506 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:41,506 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:41,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:41,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894701538 (current time:1689894701538). 2023-07-20 23:11:41,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:41,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x5a0f1562 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:41,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11df0199, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:41,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:41,598 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:41,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a0f1562 to 127.0.0.1:51258 2023-07-20 23:11:41,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:41,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x5a7e7b43 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:41,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78f8c16b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:41,757 DEBUG [hconnection-0x1142c424-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:41,763 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:41,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:41,784 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:41,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a7e7b43 to 127.0.0.1:51258 2023-07-20 23:11:41,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:41,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 23:11:41,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:41,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:41,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:41,798 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:41,799 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689895301799 2023-07-20 23:11:41,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:41,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,802 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:41,802 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:41,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:41,803 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:41,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-20 23:11:41,807 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:41,808 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689895301808 2023-07-20 23:11:41,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,831 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 23:11:41,831 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,833 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 23:11:41,833 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 23:11:41,833 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,833 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,836 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,836 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,836 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,836 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:41,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,838 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,838 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,844 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,844 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 23:11:41,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 23:11:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,845 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:41,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:41,852 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:41,854 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,854 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,854 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:41,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:41,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,859 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:41,860 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:41,860 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:41,862 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:41,864 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,864 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,864 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,865 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,865 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,865 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:41,865 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:41,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:41,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6912bf7a[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:41,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:41,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:41,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6912bf7a[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:41,870 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 23:11:41,870 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:41,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:11:41,872 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:41,873 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:41,872 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:41,875 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:41,878 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:41,878 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:41,879 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:41,880 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. started... 2023-07-20 23:11:41,881 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:41,881 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:41,881 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d0f50e9275d659a23c6b12af8814e93 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 23:11:41,881 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. started... 2023-07-20 23:11:41,881 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:41,881 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0c86c11e90b967808f5455a95c942434 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 23:11:41,904 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:41,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:41,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:41,905 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:41,931 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/.tmp/cf/27aa1a2f3e154160bbac8d1d6167fa7a 2023-07-20 23:11:41,945 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/.tmp/cf/27aa1a2f3e154160bbac8d1d6167fa7a as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf/27aa1a2f3e154160bbac8d1d6167fa7a 2023-07-20 23:11:41,951 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf/27aa1a2f3e154160bbac8d1d6167fa7a, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 23:11:41,952 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2d0f50e9275d659a23c6b12af8814e93 in 71ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:41,952 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 23:11:41,953 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d0f50e9275d659a23c6b12af8814e93: 2023-07-20 23:11:41,953 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,953 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:41,953 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf/27aa1a2f3e154160bbac8d1d6167fa7a] hfiles 2023-07-20 23:11:41,953 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf/27aa1a2f3e154160bbac8d1d6167fa7a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,962 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/.tmp/cf/bd77e345dc6347e0827e5829e47ad358 2023-07-20 23:11:41,983 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/.tmp/cf/bd77e345dc6347e0827e5829e47ad358 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf/bd77e345dc6347e0827e5829e47ad358 2023-07-20 23:11:41,993 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf/bd77e345dc6347e0827e5829e47ad358, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 23:11:41,995 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0c86c11e90b967808f5455a95c942434 in 114ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:41,997 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c86c11e90b967808f5455a95c942434: 2023-07-20 23:11:41,997 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:41,997 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:41,997 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf/bd77e345dc6347e0827e5829e47ad358] hfiles 2023-07-20 23:11:41,997 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf/bd77e345dc6347e0827e5829e47ad358 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,002 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. completed. 2023-07-20 23:11:42,002 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:11:42,002 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:42,002 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:42,002 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,007 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:42,007 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:11:42,009 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:42,009 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,009 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:42,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:42,009 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 23:11:42,020 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. completed. 2023-07-20 23:11:42,020 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:11:42,020 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:11:42,025 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,025 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:42,025 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:11:42,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 23:11:42,033 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 23:11:42,033 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:42,033 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:42,033 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,033 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:42,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:42,047 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:42,048 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:42,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:42,049 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,049 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:42,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,051 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:42,052 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,052 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:42,055 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:42,056 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:42,056 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:42,056 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:42,056 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:42,056 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,056 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,057 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,057 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:42,058 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:42,062 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,062 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:42,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:42,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:42,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:42,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:42,106 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:42,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:42,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:42,108 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:11:42,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,242 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 23:11:42,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,248 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:42,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689894701800Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689894702056 (+256 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689894702056Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689894702065 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689894702099 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689894702242 (+143 ms) 2023-07-20 23:11:42,251 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:42,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 450 msec 2023-07-20 23:11:42,408 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:42,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:42,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:42,446 DEBUG [Listener at jenkins-hbase4.apache.org/36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:11:42,450 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:11:42,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45475] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 23:11:42,453 DEBUG [Listener at jenkins-hbase4.apache.org/36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:11:42,461 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:11:42,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 23:11:42,462 DEBUG [Listener at jenkins-hbase4.apache.org/36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:11:42,464 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:11:42,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46763] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 23:11:42,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:11:42,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:42,479 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:11:42,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 23:11:42,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:42,488 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:11:42,494 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,495 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a empty. 2023-07-20 23:11:42,495 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,497 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,497 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 empty. 2023-07-20 23:11:42,498 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 23:11:42,513 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 23:11:42,522 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9af6bc3e06d9a45a14dc8705152f6c76, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:11:42,522 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a75bcca09145fda888e115fcc8d4619a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:11:42,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:42,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a75bcca09145fda888e115fcc8d4619a, disabling compactions & flushes 2023-07-20 23:11:42,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. after waiting 0 ms 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9af6bc3e06d9a45a14dc8705152f6c76, disabling compactions & flushes 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a75bcca09145fda888e115fcc8d4619a: 2023-07-20 23:11:42,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. after waiting 0 ms 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,575 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,575 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9af6bc3e06d9a45a14dc8705152f6c76: 2023-07-20 23:11:42,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:11:42,580 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894702580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894702580"}]},"ts":"1689894702580"} 2023-07-20 23:11:42,580 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894702580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894702580"}]},"ts":"1689894702580"} 2023-07-20 23:11:42,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:42,583 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:11:42,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:11:42,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894702585"}]},"ts":"1689894702585"} 2023-07-20 23:11:42,587 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 23:11:42,592 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:11:42,594 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:11:42,594 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:11:42,594 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:11:42,594 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:11:42,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, ASSIGN}] 2023-07-20 23:11:42,597 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, ASSIGN 2023-07-20 23:11:42,597 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, ASSIGN 2023-07-20 23:11:42,598 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45475,1689894621544; forceNewPlan=false, retain=false 2023-07-20 23:11:42,598 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46763,1689894621375; forceNewPlan=false, retain=false 2023-07-20 23:11:42,749 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:11:42,752 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a75bcca09145fda888e115fcc8d4619a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,752 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9af6bc3e06d9a45a14dc8705152f6c76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,752 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894702752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894702752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894702752"}]},"ts":"1689894702752"} 2023-07-20 23:11:42,752 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894702752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894702752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894702752"}]},"ts":"1689894702752"} 2023-07-20 23:11:42,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure a75bcca09145fda888e115fcc8d4619a, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:11:42,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 9af6bc3e06d9a45a14dc8705152f6c76, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:11:42,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:42,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a75bcca09145fda888e115fcc8d4619a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 23:11:42,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. service=AccessControlService 2023-07-20 23:11:42,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:42,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:42,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9af6bc3e06d9a45a14dc8705152f6c76, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 23:11:42,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. service=AccessControlService 2023-07-20 23:11:42,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:42,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:42,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,926 INFO [StoreOpener-a75bcca09145fda888e115fcc8d4619a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,926 INFO [StoreOpener-9af6bc3e06d9a45a14dc8705152f6c76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,931 DEBUG [StoreOpener-9af6bc3e06d9a45a14dc8705152f6c76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf 2023-07-20 23:11:42,931 DEBUG [StoreOpener-9af6bc3e06d9a45a14dc8705152f6c76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf 2023-07-20 23:11:42,932 INFO [StoreOpener-9af6bc3e06d9a45a14dc8705152f6c76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9af6bc3e06d9a45a14dc8705152f6c76 columnFamilyName cf 2023-07-20 23:11:42,932 DEBUG [StoreOpener-a75bcca09145fda888e115fcc8d4619a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf 2023-07-20 23:11:42,933 DEBUG [StoreOpener-a75bcca09145fda888e115fcc8d4619a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf 2023-07-20 23:11:42,933 INFO [StoreOpener-a75bcca09145fda888e115fcc8d4619a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a75bcca09145fda888e115fcc8d4619a columnFamilyName cf 2023-07-20 23:11:42,933 INFO [StoreOpener-9af6bc3e06d9a45a14dc8705152f6c76-1] regionserver.HStore(310): Store=9af6bc3e06d9a45a14dc8705152f6c76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:42,934 INFO [StoreOpener-a75bcca09145fda888e115fcc8d4619a-1] regionserver.HStore(310): Store=a75bcca09145fda888e115fcc8d4619a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:42,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:42,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:42,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:42,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a75bcca09145fda888e115fcc8d4619a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59335239, jitterRate=-0.11583603918552399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:42,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a75bcca09145fda888e115fcc8d4619a: 2023-07-20 23:11:42,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a., pid=69, masterSystemTime=1689894702908 2023-07-20 23:11:42,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:42,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9af6bc3e06d9a45a14dc8705152f6c76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68927564, jitterRate=0.027100741863250732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9af6bc3e06d9a45a14dc8705152f6c76: 2023-07-20 23:11:42,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:42,949 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a75bcca09145fda888e115fcc8d4619a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:42,949 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894702949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894702949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894702949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894702949"}]},"ts":"1689894702949"} 2023-07-20 23:11:42,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76., pid=70, masterSystemTime=1689894702911 2023-07-20 23:11:42,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-20 23:11:42,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure a75bcca09145fda888e115fcc8d4619a, server=jenkins-hbase4.apache.org,46763,1689894621375 in 197 msec 2023-07-20 23:11:42,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:42,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9af6bc3e06d9a45a14dc8705152f6c76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:42,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894702957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894702957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894702957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894702957"}]},"ts":"1689894702957"} 2023-07-20 23:11:42,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, ASSIGN in 362 msec 2023-07-20 23:11:42,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-20 23:11:42,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 9af6bc3e06d9a45a14dc8705152f6c76, server=jenkins-hbase4.apache.org,45475,1689894621544 in 203 msec 2023-07-20 23:11:42,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-20 23:11:42,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, ASSIGN in 377 msec 2023-07-20 23:11:42,979 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:11:42,980 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894702979"}]},"ts":"1689894702979"} 2023-07-20 23:11:42,981 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 23:11:42,985 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:11:42,986 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 23:11:42,991 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 23:11:42,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:42,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:42,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:42,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:42,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:42,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:42,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:43,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:43,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:43,000 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:43,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 532 msec 2023-07-20 23:11:43,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:43,002 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:43,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:43,089 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 23:11:43,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a75bcca09145fda888e115fcc8d4619a, 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:43,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a75bcca09145fda888e115fcc8d4619a, 9af6bc3e06d9a45a14dc8705152f6c76], force=true 2023-07-20 23:11:43,146 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a75bcca09145fda888e115fcc8d4619a, 9af6bc3e06d9a45a14dc8705152f6c76], force=true 2023-07-20 23:11:43,146 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a75bcca09145fda888e115fcc8d4619a, 9af6bc3e06d9a45a14dc8705152f6c76], force=true 2023-07-20 23:11:43,147 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a75bcca09145fda888e115fcc8d4619a, 9af6bc3e06d9a45a14dc8705152f6c76], force=true 2023-07-20 23:11:43,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:43,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, UNASSIGN}] 2023-07-20 23:11:43,191 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, UNASSIGN 2023-07-20 23:11:43,191 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, UNASSIGN 2023-07-20 23:11:43,192 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9af6bc3e06d9a45a14dc8705152f6c76, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:43,192 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a75bcca09145fda888e115fcc8d4619a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:43,193 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894703192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894703192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894703192"}]},"ts":"1689894703192"} 2023-07-20 23:11:43,195 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894703192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894703192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894703192"}]},"ts":"1689894703192"} 2023-07-20 23:11:43,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 9af6bc3e06d9a45a14dc8705152f6c76, server=jenkins-hbase4.apache.org,45475,1689894621544}] 2023-07-20 23:11:43,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a75bcca09145fda888e115fcc8d4619a, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:11:43,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:43,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:43,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9af6bc3e06d9a45a14dc8705152f6c76, disabling compactions & flushes 2023-07-20 23:11:43,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:43,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:43,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. after waiting 0 ms 2023-07-20 23:11:43,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:43,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:43,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9af6bc3e06d9a45a14dc8705152f6c76 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 23:11:43,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a75bcca09145fda888e115fcc8d4619a, disabling compactions & flushes 2023-07-20 23:11:43,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:43,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:43,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. after waiting 0 ms 2023-07-20 23:11:43,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:43,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a75bcca09145fda888e115fcc8d4619a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 23:11:43,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/.tmp/cf/a5eb72d168954705812b76043398c98b 2023-07-20 23:11:43,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/.tmp/cf/b7c07e5fd87848ac9c1fb17f87f3fc14 2023-07-20 23:11:43,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/.tmp/cf/a5eb72d168954705812b76043398c98b as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf/a5eb72d168954705812b76043398c98b 2023-07-20 23:11:43,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/.tmp/cf/b7c07e5fd87848ac9c1fb17f87f3fc14 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf/b7c07e5fd87848ac9c1fb17f87f3fc14 2023-07-20 23:11:43,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf/a5eb72d168954705812b76043398c98b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 23:11:43,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9af6bc3e06d9a45a14dc8705152f6c76 in 40ms, sequenceid=5, compaction requested=false 2023-07-20 23:11:43,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 23:11:43,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf/b7c07e5fd87848ac9c1fb17f87f3fc14, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 23:11:43,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a75bcca09145fda888e115fcc8d4619a in 39ms, sequenceid=5, compaction requested=false 2023-07-20 23:11:43,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 23:11:43,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 23:11:43,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:43,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76. 2023-07-20 23:11:43,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9af6bc3e06d9a45a14dc8705152f6c76: 2023-07-20 23:11:43,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:43,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a. 2023-07-20 23:11:43,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a75bcca09145fda888e115fcc8d4619a: 2023-07-20 23:11:43,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:11:43,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9af6bc3e06d9a45a14dc8705152f6c76, regionState=CLOSED 2023-07-20 23:11:43,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894703421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894703421"}]},"ts":"1689894703421"} 2023-07-20 23:11:43,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:11:43,424 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a75bcca09145fda888e115fcc8d4619a, regionState=CLOSED 2023-07-20 23:11:43,424 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894703424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894703424"}]},"ts":"1689894703424"} 2023-07-20 23:11:43,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-20 23:11:43,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 9af6bc3e06d9a45a14dc8705152f6c76, server=jenkins-hbase4.apache.org,45475,1689894621544 in 227 msec 2023-07-20 23:11:43,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9af6bc3e06d9a45a14dc8705152f6c76, UNASSIGN in 237 msec 2023-07-20 23:11:43,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-20 23:11:43,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a75bcca09145fda888e115fcc8d4619a, server=jenkins-hbase4.apache.org,46763,1689894621375 in 228 msec 2023-07-20 23:11:43,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-20 23:11:43,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a75bcca09145fda888e115fcc8d4619a, UNASSIGN in 251 msec 2023-07-20 23:11:43,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:43,523 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 23:11:43,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702466.a75bcca09145fda888e115fcc8d4619a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:43,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894702466.9af6bc3e06d9a45a14dc8705152f6c76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:43,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:43,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, ASSIGN}] 2023-07-20 23:11:43,596 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, ASSIGN 2023-07-20 23:11:43,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46763,1689894621375; forceNewPlan=false, retain=false 2023-07-20 23:11:43,749 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 23:11:43,752 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0c120df51ddb0058b3a875ad2bf7da2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:43,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894703752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894703752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894703752"}]},"ts":"1689894703752"} 2023-07-20 23:11:43,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0c120df51ddb0058b3a875ad2bf7da2b, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:11:43,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:43,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:11:43,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c120df51ddb0058b3a875ad2bf7da2b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:11:43,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. service=AccessControlService 2023-07-20 23:11:43,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:43,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/.regioninfo 2023-07-20 23:11:43,934 INFO [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,936 DEBUG [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf 2023-07-20 23:11:43,936 DEBUG [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf 2023-07-20 23:11:43,936 INFO [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c120df51ddb0058b3a875ad2bf7da2b columnFamilyName cf 2023-07-20 23:11:43,976 DEBUG [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] regionserver.HStore(539): loaded hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/a5eb72d168954705812b76043398c98b.9af6bc3e06d9a45a14dc8705152f6c76->hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf/a5eb72d168954705812b76043398c98b-top 2023-07-20 23:11:43,983 DEBUG [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] regionserver.HStore(539): loaded hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/b7c07e5fd87848ac9c1fb17f87f3fc14.a75bcca09145fda888e115fcc8d4619a->hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf/b7c07e5fd87848ac9c1fb17f87f3fc14-top 2023-07-20 23:11:43,984 INFO [StoreOpener-0c120df51ddb0058b3a875ad2bf7da2b-1] regionserver.HStore(310): Store=0c120df51ddb0058b3a875ad2bf7da2b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:43,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:11:43,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c120df51ddb0058b3a875ad2bf7da2b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74838551, jitterRate=0.11518131196498871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:43,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c120df51ddb0058b3a875ad2bf7da2b: 2023-07-20 23:11:43,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b., pid=77, masterSystemTime=1689894703908 2023-07-20 23:11:43,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.,because compaction is disabled. 2023-07-20 23:11:43,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:11:43,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:11:43,998 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0c120df51ddb0058b3a875ad2bf7da2b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:43,998 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894703998"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894703998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894703998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894703998"}]},"ts":"1689894703998"} 2023-07-20 23:11:44,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 23:11:44,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0c120df51ddb0058b3a875ad2bf7da2b, server=jenkins-hbase4.apache.org,46763,1689894621375 in 245 msec 2023-07-20 23:11:44,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 23:11:44,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, ASSIGN in 408 msec 2023-07-20 23:11:44,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a75bcca09145fda888e115fcc8d4619a, 9af6bc3e06d9a45a14dc8705152f6c76], force=true in 869 msec 2023-07-20 23:11:44,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:44,261 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 23:11:44,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 23:11:44,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894704262 (current time:1689894704262). 2023-07-20 23:11:44,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:44,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x6b63024c to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:44,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b00b882, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:44,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:44,273 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:44,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b63024c to 127.0.0.1:51258 2023-07-20 23:11:44,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:44,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x2ed119ff to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:44,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d530f0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:44,281 DEBUG [hconnection-0x5399788b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:44,283 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:44,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:44,290 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:44,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ed119ff to 127.0.0.1:51258 2023-07-20 23:11:44,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:44,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 23:11:44,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:44,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 23:11:44,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 23:11:44,295 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 23:11:44,296 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689895304296 2023-07-20 23:11:44,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 23:11:44,300 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:44,300 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:44,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 23:11:44,301 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 23:11:44,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-20 23:11:44,303 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 23:11:44,303 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689895304303 2023-07-20 23:11:44,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,315 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 23:11:44,315 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:44,317 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 23:11:44,317 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 23:11:44,317 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,317 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,319 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,319 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,319 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,319 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,320 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,320 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 23:11:44,321 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 23:11:44,321 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 23:11:44,321 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 23:11:44,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 23:11:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 23:11:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 23:11:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 23:11:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 23:11:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 23:11:44,328 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,329 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,329 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:44,330 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,330 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,330 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:44,330 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,330 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:44,330 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,330 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:44,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 23:11:44,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bd5a9d1[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:44,332 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 23:11:44,332 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 23:11:44,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,334 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 23:11:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 23:11:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 23:11:44,335 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 23:11:44,335 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:11:44,335 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:44,335 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:44,334 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:11:44,335 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:11:44,335 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. started... 2023-07-20 23:11:44,336 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c120df51ddb0058b3a875ad2bf7da2b: 2023-07-20 23:11:44,337 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,337 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:44,337 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/a5eb72d168954705812b76043398c98b.9af6bc3e06d9a45a14dc8705152f6c76->hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf/a5eb72d168954705812b76043398c98b-top, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/b7c07e5fd87848ac9c1fb17f87f3fc14.a75bcca09145fda888e115fcc8d4619a->hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf/b7c07e5fd87848ac9c1fb17f87f3fc14-top] hfiles 2023-07-20 23:11:44,337 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/a5eb72d168954705812b76043398c98b.9af6bc3e06d9a45a14dc8705152f6c76 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,337 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 23:11:44,337 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:44,337 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 23:11:44,339 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/b7c07e5fd87848ac9c1fb17f87f3fc14.a75bcca09145fda888e115fcc8d4619a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 23:11:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 23:11:44,355 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. completed. 2023-07-20 23:11:44,355 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:11:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 23:11:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:11:44,361 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 23:11:44,361 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,361 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:44,361 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 23:11:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:11:44,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 23:11:44,367 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 23:11:44,367 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:44,367 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:44,367 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,367 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:44,369 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:44,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:44,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,369 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,370 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:44,370 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,371 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:44,371 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:44,381 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,381 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,382 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,387 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,388 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:11:44,388 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,388 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:11:44,388 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:11:44,388 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,388 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,387 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:44,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,399 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,399 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,399 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,399 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,400 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:44,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 23:11:44,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:44,402 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:44,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 23:11:44,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,541 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689894704296Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704387 (+91 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704387Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704393 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704443 (+50 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689894704541 (+98 ms) 2023-07-20 23:11:44,545 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 23:11:44,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 246 msec 2023-07-20 23:11:44,602 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:44,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 23:11:44,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:44,612 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612 2023-07-20 23:11:44,612 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33785, tgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612, rawTgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:11:44,648 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:11:44,648 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1297992239_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,648 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 23:11:44,671 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,735 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,736 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,736 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,737 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,737 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,737 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,738 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:44,828 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-5525690523551556090.jar 2023-07-20 23:11:44,828 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,829 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,829 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,830 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,830 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,832 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:11:44,832 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:11:44,833 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:11:44,833 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:11:44,833 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:11:44,834 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:11:44,834 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:11:44,834 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:11:44,835 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:11:44,835 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:11:44,836 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,836 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,836 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:44,837 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,837 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,837 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:44,838 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:45,634 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:11:45,638 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 23:11:45,641 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 23:11:45,644 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:11:45,897 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:45,897 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:45,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0005_000001 (auth:SIMPLE) 2023-07-20 23:11:51,849 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0005_000001 (auth:SIMPLE) 2023-07-20 23:11:54,170 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0005_000001 (auth:SIMPLE) 2023-07-20 23:11:58,930 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0005_000001 (auth:SIMPLE) 2023-07-20 23:12:00,189 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:12:00,195 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:12:00,204 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,205 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:12:00,205 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:12:00,206 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,207 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 23:12:00,207 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 23:12:00,207 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,208 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 23:12:00,208 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894704612/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 23:12:00,216 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 23:12:00,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894720224"}]},"ts":"1689894720224"} 2023-07-20 23:12:00,226 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 23:12:00,229 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 23:12:00,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, UNASSIGN}] 2023-07-20 23:12:00,235 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, UNASSIGN 2023-07-20 23:12:00,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0c120df51ddb0058b3a875ad2bf7da2b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:00,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894720236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894720236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894720236"}]},"ts":"1689894720236"} 2023-07-20 23:12:00,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0c120df51ddb0058b3a875ad2bf7da2b, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:12:00,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 23:12:00,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:12:00,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c120df51ddb0058b3a875ad2bf7da2b, disabling compactions & flushes 2023-07-20 23:12:00,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:12:00,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:12:00,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. after waiting 0 ms 2023-07-20 23:12:00,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:12:00,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 23:12:00,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:00,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b. 2023-07-20 23:12:00,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c120df51ddb0058b3a875ad2bf7da2b: 2023-07-20 23:12:00,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:12:00,421 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0c120df51ddb0058b3a875ad2bf7da2b, regionState=CLOSED 2023-07-20 23:12:00,421 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894720421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894720421"}]},"ts":"1689894720421"} 2023-07-20 23:12:00,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 23:12:00,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0c120df51ddb0058b3a875ad2bf7da2b, server=jenkins-hbase4.apache.org,46763,1689894621375 in 185 msec 2023-07-20 23:12:00,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 23:12:00,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c120df51ddb0058b3a875ad2bf7da2b, UNASSIGN in 196 msec 2023-07-20 23:12:00,430 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894720430"}]},"ts":"1689894720430"} 2023-07-20 23:12:00,431 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 23:12:00,434 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 23:12:00,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 217 msec 2023-07-20 23:12:00,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 23:12:00,527 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 23:12:00,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,535 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,537 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,537 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,543 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:12:00,543 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:12:00,544 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:12:00,544 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,545 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/recovered.edits] 2023-07-20 23:12:00,545 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,545 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,545 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:00,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:00,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:00,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:00,546 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,547 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:00,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:00,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:00,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 23:12:00,550 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/recovered.edits] 2023-07-20 23:12:00,553 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf/a5eb72d168954705812b76043398c98b to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/cf/a5eb72d168954705812b76043398c98b 2023-07-20 23:12:00,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:00,557 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/recovered.edits] 2023-07-20 23:12:00,559 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf/b7c07e5fd87848ac9c1fb17f87f3fc14 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/cf/b7c07e5fd87848ac9c1fb17f87f3fc14 2023-07-20 23:12:00,560 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/recovered.edits/8.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76/recovered.edits/8.seqid 2023-07-20 23:12:00,564 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:12:00,568 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/a5eb72d168954705812b76043398c98b.9af6bc3e06d9a45a14dc8705152f6c76 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/a5eb72d168954705812b76043398c98b.9af6bc3e06d9a45a14dc8705152f6c76 2023-07-20 23:12:00,571 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/b7c07e5fd87848ac9c1fb17f87f3fc14.a75bcca09145fda888e115fcc8d4619a to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/cf/b7c07e5fd87848ac9c1fb17f87f3fc14.a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:12:00,573 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/recovered.edits/8.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a/recovered.edits/8.seqid 2023-07-20 23:12:00,574 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a75bcca09145fda888e115fcc8d4619a 2023-07-20 23:12:00,580 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/recovered.edits/12.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b/recovered.edits/12.seqid 2023-07-20 23:12:00,581 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c120df51ddb0058b3a875ad2bf7da2b 2023-07-20 23:12:00,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 23:12:00,584 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,593 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 23:12:00,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 23:12:00,598 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,598 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 23:12:00,598 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894720598"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:00,610 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 23:12:00,610 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0c120df51ddb0058b3a875ad2bf7da2b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894702467.0c120df51ddb0058b3a875ad2bf7da2b.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 23:12:00,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 23:12:00,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894720610"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:00,613 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 23:12:00,616 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:00,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 88 msec 2023-07-20 23:12:00,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 23:12:00,650 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 23:12:00,651 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,658 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894720658"}]},"ts":"1689894720658"} 2023-07-20 23:12:00,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 23:12:00,660 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 23:12:00,666 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 23:12:00,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, UNASSIGN}] 2023-07-20 23:12:00,674 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, UNASSIGN 2023-07-20 23:12:00,674 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, UNASSIGN 2023-07-20 23:12:00,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0c86c11e90b967808f5455a95c942434, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:00,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2d0f50e9275d659a23c6b12af8814e93, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:00,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894720676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894720676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894720676"}]},"ts":"1689894720676"} 2023-07-20 23:12:00,677 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894720676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894720676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894720676"}]},"ts":"1689894720676"} 2023-07-20 23:12:00,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 0c86c11e90b967808f5455a95c942434, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:12:00,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2d0f50e9275d659a23c6b12af8814e93, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:12:00,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 23:12:00,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c86c11e90b967808f5455a95c942434 2023-07-20 23:12:00,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c86c11e90b967808f5455a95c942434, disabling compactions & flushes 2023-07-20 23:12:00,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:12:00,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:12:00,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. after waiting 0 ms 2023-07-20 23:12:00,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:12:00,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:12:00,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d0f50e9275d659a23c6b12af8814e93, disabling compactions & flushes 2023-07-20 23:12:00,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:12:00,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:12:00,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. after waiting 0 ms 2023-07-20 23:12:00,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:12:00,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:00,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:00,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434. 2023-07-20 23:12:00,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c86c11e90b967808f5455a95c942434: 2023-07-20 23:12:00,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c86c11e90b967808f5455a95c942434 2023-07-20 23:12:00,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:00,860 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0c86c11e90b967808f5455a95c942434, regionState=CLOSED 2023-07-20 23:12:00,861 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894720860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894720860"}]},"ts":"1689894720860"} 2023-07-20 23:12:00,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:00,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93. 2023-07-20 23:12:00,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d0f50e9275d659a23c6b12af8814e93: 2023-07-20 23:12:00,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:12:00,864 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2d0f50e9275d659a23c6b12af8814e93, regionState=CLOSED 2023-07-20 23:12:00,864 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894720864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894720864"}]},"ts":"1689894720864"} 2023-07-20 23:12:00,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-20 23:12:00,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 0c86c11e90b967808f5455a95c942434, server=jenkins-hbase4.apache.org,45507,1689894621469 in 180 msec 2023-07-20 23:12:00,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c86c11e90b967808f5455a95c942434, UNASSIGN in 199 msec 2023-07-20 23:12:00,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-20 23:12:00,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2d0f50e9275d659a23c6b12af8814e93, server=jenkins-hbase4.apache.org,46763,1689894621375 in 180 msec 2023-07-20 23:12:00,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-20 23:12:00,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2d0f50e9275d659a23c6b12af8814e93, UNASSIGN in 201 msec 2023-07-20 23:12:00,877 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894720877"}]},"ts":"1689894720877"} 2023-07-20 23:12:00,879 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 23:12:00,881 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 23:12:00,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 230 msec 2023-07-20 23:12:00,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 23:12:00,962 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 23:12:00,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,967 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,968 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,969 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,976 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 2023-07-20 23:12:00,976 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:12:00,978 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/recovered.edits] 2023-07-20 23:12:00,979 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/recovered.edits] 2023-07-20 23:12:00,980 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,980 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,981 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,981 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:00,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:00,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:00,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,983 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:00,984 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:00,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 23:12:00,986 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf/bd77e345dc6347e0827e5829e47ad358 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/cf/bd77e345dc6347e0827e5829e47ad358 2023-07-20 23:12:00,988 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf/27aa1a2f3e154160bbac8d1d6167fa7a to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/cf/27aa1a2f3e154160bbac8d1d6167fa7a 2023-07-20 23:12:00,990 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434/recovered.edits/9.seqid 2023-07-20 23:12:00,991 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c86c11e90b967808f5455a95c942434 2023-07-20 23:12:00,992 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93/recovered.edits/9.seqid 2023-07-20 23:12:00,992 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2d0f50e9275d659a23c6b12af8814e93 2023-07-20 23:12:00,992 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 23:12:01,001 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,004 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 23:12:01,008 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 23:12:01,010 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,010 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 23:12:01,010 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894721010"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:01,010 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894721010"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:01,015 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:12:01,015 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0c86c11e90b967808f5455a95c942434, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689894700361.0c86c11e90b967808f5455a95c942434.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2d0f50e9275d659a23c6b12af8814e93, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894700361.2d0f50e9275d659a23c6b12af8814e93.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:12:01,015 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 23:12:01,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894721015"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:01,017 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 23:12:01,020 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 57 msec 2023-07-20 23:12:01,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 23:12:01,086 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 23:12:01,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 23:12:01,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 23:12:01,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 23:12:01,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,154 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 748) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:40399 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:53506 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:58468 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3828 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:56298 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_115420765_1 at /127.0.0.1:53490 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_115420765_1 at /127.0.0.1:58446 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=588 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1522 (was 1323) - AvailableMemoryMB LEAK? - 2023-07-20 23:12:01,154 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-20 23:12:01,179 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=588, ProcessCount=183, AvailableMemoryMB=1518 2023-07-20 23:12:01,179 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-20 23:12:01,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:12:01,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:01,189 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:12:01,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 23:12:01,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:12:01,193 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,193 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,194 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 empty. 2023-07-20 23:12:01,194 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c empty. 2023-07-20 23:12:01,195 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,195 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,195 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 23:12:01,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:01,219 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 23:12:01,221 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fc529e43de5ccda62bb1233b5714940c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:12:01,221 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b86896f3069e1f828d29d5ae1f5d8405, NAME => 'testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:12:01,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:01,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fc529e43de5ccda62bb1233b5714940c, disabling compactions & flushes 2023-07-20 23:12:01,259 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. after waiting 0 ms 2023-07-20 23:12:01,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,259 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,259 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fc529e43de5ccda62bb1233b5714940c: 2023-07-20 23:12:01,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:01,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b86896f3069e1f828d29d5ae1f5d8405, disabling compactions & flushes 2023-07-20 23:12:01,271 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. after waiting 0 ms 2023-07-20 23:12:01,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,271 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,271 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b86896f3069e1f828d29d5ae1f5d8405: 2023-07-20 23:12:01,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:12:01,281 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894721281"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894721281"}]},"ts":"1689894721281"} 2023-07-20 23:12:01,281 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894721281"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894721281"}]},"ts":"1689894721281"} 2023-07-20 23:12:01,287 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:12:01,288 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:12:01,288 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894721288"}]},"ts":"1689894721288"} 2023-07-20 23:12:01,290 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 23:12:01,294 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:12:01,296 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:12:01,296 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:12:01,296 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:12:01,296 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:12:01,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, ASSIGN}] 2023-07-20 23:12:01,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:01,302 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, ASSIGN 2023-07-20 23:12:01,302 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, ASSIGN 2023-07-20 23:12:01,303 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46763,1689894621375; forceNewPlan=false, retain=false 2023-07-20 23:12:01,303 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:12:01,454 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:12:01,458 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fc529e43de5ccda62bb1233b5714940c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:01,458 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894721458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894721458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894721458"}]},"ts":"1689894721458"} 2023-07-20 23:12:01,458 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b86896f3069e1f828d29d5ae1f5d8405, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:01,459 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894721458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894721458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894721458"}]},"ts":"1689894721458"} 2023-07-20 23:12:01,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure fc529e43de5ccda62bb1233b5714940c, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:12:01,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure b86896f3069e1f828d29d5ae1f5d8405, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:12:01,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:01,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b86896f3069e1f828d29d5ae1f5d8405, NAME => 'testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:12:01,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. service=AccessControlService 2023-07-20 23:12:01,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:01,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:01,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc529e43de5ccda62bb1233b5714940c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:12:01,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. service=AccessControlService 2023-07-20 23:12:01,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:01,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:01,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,621 INFO [StoreOpener-b86896f3069e1f828d29d5ae1f5d8405-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,622 INFO [StoreOpener-fc529e43de5ccda62bb1233b5714940c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,622 DEBUG [StoreOpener-b86896f3069e1f828d29d5ae1f5d8405-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf 2023-07-20 23:12:01,623 DEBUG [StoreOpener-b86896f3069e1f828d29d5ae1f5d8405-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf 2023-07-20 23:12:01,623 INFO [StoreOpener-b86896f3069e1f828d29d5ae1f5d8405-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b86896f3069e1f828d29d5ae1f5d8405 columnFamilyName cf 2023-07-20 23:12:01,623 DEBUG [StoreOpener-fc529e43de5ccda62bb1233b5714940c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf 2023-07-20 23:12:01,624 DEBUG [StoreOpener-fc529e43de5ccda62bb1233b5714940c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf 2023-07-20 23:12:01,624 INFO [StoreOpener-fc529e43de5ccda62bb1233b5714940c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc529e43de5ccda62bb1233b5714940c columnFamilyName cf 2023-07-20 23:12:01,625 INFO [StoreOpener-fc529e43de5ccda62bb1233b5714940c-1] regionserver.HStore(310): Store=fc529e43de5ccda62bb1233b5714940c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:01,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,626 INFO [StoreOpener-b86896f3069e1f828d29d5ae1f5d8405-1] regionserver.HStore(310): Store=b86896f3069e1f828d29d5ae1f5d8405/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:01,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:01,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:01,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:01,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fc529e43de5ccda62bb1233b5714940c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71638482, jitterRate=0.06749656796455383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:01,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fc529e43de5ccda62bb1233b5714940c: 2023-07-20 23:12:01,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:01,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b86896f3069e1f828d29d5ae1f5d8405; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61021681, jitterRate=-0.09070609509944916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:01,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b86896f3069e1f828d29d5ae1f5d8405: 2023-07-20 23:12:01,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405., pid=94, masterSystemTime=1689894721614 2023-07-20 23:12:01,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c., pid=93, masterSystemTime=1689894721614 2023-07-20 23:12:01,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:01,637 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b86896f3069e1f828d29d5ae1f5d8405, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:01,637 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894721637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894721637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894721637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894721637"}]},"ts":"1689894721637"} 2023-07-20 23:12:01,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:01,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fc529e43de5ccda62bb1233b5714940c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:01,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894721638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894721638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894721638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894721638"}]},"ts":"1689894721638"} 2023-07-20 23:12:01,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-20 23:12:01,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-20 23:12:01,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure fc529e43de5ccda62bb1233b5714940c, server=jenkins-hbase4.apache.org,45507,1689894621469 in 179 msec 2023-07-20 23:12:01,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure b86896f3069e1f828d29d5ae1f5d8405, server=jenkins-hbase4.apache.org,46763,1689894621375 in 176 msec 2023-07-20 23:12:01,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, ASSIGN in 347 msec 2023-07-20 23:12:01,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-20 23:12:01,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, ASSIGN in 347 msec 2023-07-20 23:12:01,645 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:12:01,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894721645"}]},"ts":"1689894721645"} 2023-07-20 23:12:01,646 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 23:12:01,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:12:01,650 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 23:12:01,652 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:12:01,653 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,653 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,653 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,653 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 473 msec 2023-07-20 23:12:01,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:01,800 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 23:12:01,800 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-20 23:12:01,800 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:01,803 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-20 23:12:01,803 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:01,804 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-20 23:12:01,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:01,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894721806 (current time:1689894721806). 2023-07-20 23:12:01,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:01,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x1a963028 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:01,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26668693, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:01,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:01,901 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:01,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a963028 to 127.0.0.1:51258 2023-07-20 23:12:01,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x54d05a24 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:01,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f6c37e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:01,986 DEBUG [hconnection-0x6dac6486-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:01,987 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:01,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:01,995 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54d05a24 to 127.0.0.1:51258 2023-07-20 23:12:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:12:01,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:01,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:02,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:02,042 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:02,043 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895322043 2023-07-20 23:12:02,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:02,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:02,045 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:02,045 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:02,046 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:02,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:02,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-20 23:12:02,051 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:02,051 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895322051 2023-07-20 23:12:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,069 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 23:12:02,069 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,071 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 23:12:02,071 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:12:02,071 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,071 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,145 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:02,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:02,147 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:02,222 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,223 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,223 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,223 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,224 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,224 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,224 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,224 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:02,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 23:12:02,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 23:12:02,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 23:12:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,226 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,226 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:02,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,227 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:02,227 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:02,237 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:02,237 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:02,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:02,241 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:02,241 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:02,241 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:02,268 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,299 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,300 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,322 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,322 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,322 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,323 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c24da17[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:02,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c24da17[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:02,332 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:12:02,332 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,347 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:02,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:02,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:02,349 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:02,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:02,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:02,384 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:12:02,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:02,385 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:02,385 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,385 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:02,385 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. started... 2023-07-20 23:12:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:02,394 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:02,394 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:02,394 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b86896f3069e1f828d29d5ae1f5d8405: 2023-07-20 23:12:02,394 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. started... 2023-07-20 23:12:02,395 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,395 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc529e43de5ccda62bb1233b5714940c: 2023-07-20 23:12:02,395 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:02,396 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:02,396 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,396 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:02,396 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:02,415 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:02,415 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:02,415 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:02,466 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. completed. 2023-07-20 23:12:02,467 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:02,467 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:12:02,469 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. completed. 2023-07-20 23:12:02,469 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:02,469 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:12:02,491 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,491 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:02,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,492 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:02,492 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:02,530 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:02,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,530 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:02,530 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:02,530 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:12:02,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:12:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:12:02,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:12:02,540 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 23:12:02,540 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:02,540 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:02,540 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,540 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:02,569 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:02,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,569 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:02,569 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:02,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,570 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:02,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:02,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,572 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,573 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,575 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,578 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,578 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,579 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:02,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,630 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:02,630 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:02,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:02,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:02,633 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,634 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,649 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:02,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:02,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:02,650 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:12:02,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 23:12:02,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,696 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689894722043Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689894722630 (+587 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689894722631 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689894722639 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689894722659 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689894722695 (+36 ms) 2023-07-20 23:12:02,699 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:02,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 654 msec 2023-07-20 23:12:03,151 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:03,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46763] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:03,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:03,182 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:03,183 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:03,183 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:03,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:03,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894723196 (current time:1689894723196). 2023-07-20 23:12:03,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:03,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x0c9467d1 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:03,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@212ba91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:03,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:03,210 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:03,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c9467d1 to 127.0.0.1:51258 2023-07-20 23:12:03,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:03,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x6f367e90 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:03,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40333648, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:03,233 DEBUG [hconnection-0x5762daed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:03,237 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:03,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:03,242 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:03,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f367e90 to 127.0.0.1:51258 2023-07-20 23:12:03,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:03,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:12:03,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:03,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:03,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:03,250 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:03,253 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895323253 2023-07-20 23:12:03,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:03,257 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:03,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:03,258 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:03,258 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:03,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-20 23:12:03,260 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:03,260 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895323260 2023-07-20 23:12:03,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,285 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 23:12:03,285 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:03,286 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 23:12:03,286 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:12:03,287 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,287 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,289 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,289 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,289 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,289 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,289 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,289 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,290 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,290 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 23:12:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:03,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 23:12:03,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:03,291 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:03,291 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:03,293 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:03,293 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:03,293 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:03,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,294 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:03,294 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 23:12:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,296 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:03,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:03,296 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:03,296 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:03,296 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,296 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,296 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,296 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:03,297 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,298 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,298 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:03,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:03,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@102140a5[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:03,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,304 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:03,304 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:03,309 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:03,309 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:03,309 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:03,311 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,311 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:03,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@102140a5[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:03,316 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:12:03,316 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:03,322 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:03,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:03,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,323 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:12:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,323 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:03,325 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,325 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:03,331 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,331 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,331 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:03,331 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:03,333 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:03,333 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. started... 2023-07-20 23:12:03,334 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc529e43de5ccda62bb1233b5714940c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-20 23:12:03,334 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:03,334 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. started... 2023-07-20 23:12:03,335 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b86896f3069e1f828d29d5ae1f5d8405 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-20 23:12:03,359 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:03,360 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:03,426 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/.tmp/cf/d8f2ce75fab845c198b4af9b31b07621 2023-07-20 23:12:03,426 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/.tmp/cf/189bbbdbfa0c47068fe73c6566f74e4f 2023-07-20 23:12:03,433 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/.tmp/cf/d8f2ce75fab845c198b4af9b31b07621 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf/d8f2ce75fab845c198b4af9b31b07621 2023-07-20 23:12:03,438 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/.tmp/cf/189bbbdbfa0c47068fe73c6566f74e4f as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf/189bbbdbfa0c47068fe73c6566f74e4f 2023-07-20 23:12:03,442 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf/d8f2ce75fab845c198b4af9b31b07621, entries=2, sequenceid=6, filesize=5.0 K 2023-07-20 23:12:03,444 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b86896f3069e1f828d29d5ae1f5d8405 in 110ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:03,444 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 23:12:03,444 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b86896f3069e1f828d29d5ae1f5d8405: 2023-07-20 23:12:03,445 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,445 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:03,445 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf/d8f2ce75fab845c198b4af9b31b07621] hfiles 2023-07-20 23:12:03,445 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf/d8f2ce75fab845c198b4af9b31b07621 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,453 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf/189bbbdbfa0c47068fe73c6566f74e4f, entries=48, sequenceid=6, filesize=8.1 K 2023-07-20 23:12:03,454 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fc529e43de5ccda62bb1233b5714940c in 120ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:03,466 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc529e43de5ccda62bb1233b5714940c: 2023-07-20 23:12:03,466 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,493 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:03,493 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf/189bbbdbfa0c47068fe73c6566f74e4f] hfiles 2023-07-20 23:12:03,493 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf/189bbbdbfa0c47068fe73c6566f74e4f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,504 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. completed. 2023-07-20 23:12:03,504 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:03,505 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:03,505 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:03,505 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,505 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:03,505 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:12:03,507 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:03,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:12:03,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:12:03,522 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. completed. 2023-07-20 23:12:03,522 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:03,522 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:03,522 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:03,522 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,522 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:03,522 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:12:03,524 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:03,524 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,525 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,525 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:03,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:12:03,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:12:03,532 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 23:12:03,532 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:03,532 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:03,532 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,532 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,537 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,538 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,539 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,542 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,543 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,544 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,555 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,555 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,555 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,555 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,555 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,555 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,558 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,557 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,561 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,561 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,561 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,562 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:03,564 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:03,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 23:12:03,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,682 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689894723254Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689894723561 (+307 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689894723561Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689894723578 (+17 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689894723608 (+30 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689894723681 (+73 ms) 2023-07-20 23:12:03,689 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:03,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 434 msec 2023-07-20 23:12:03,864 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:03,866 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866 2023-07-20 23:12:03,866 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33785, tgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866, rawTgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:12:03,888 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:12:03,888 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-331897388_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,889 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 23:12:03,895 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,929 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:03,930 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:03,930 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:03,932 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:03,932 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,015 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-1422523646069147729.jar 2023-07-20 23:12:04,015 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,016 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,016 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,017 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,017 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:12:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:12:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:12:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:12:04,019 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:12:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:12:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:12:04,020 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:12:04,021 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:12:04,021 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:12:04,022 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,022 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,023 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:04,023 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,023 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,024 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:04,024 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:04,716 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:12:04,719 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 23:12:05,117 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:05,117 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:05,120 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0005_000001 (auth:SIMPLE) 2023-07-20 23:12:05,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0006_000001 (auth:SIMPLE) 2023-07-20 23:12:06,026 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:12:12,646 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0006_000001 (auth:SIMPLE) 2023-07-20 23:12:15,145 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:12:15,148 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:12:15,155 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,155 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:12:15,155 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:12:15,156 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,156 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 23:12:15,156 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 23:12:15,156 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,157 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 23:12:15,157 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894723866/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 23:12:15,177 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 23:12:15,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894735183"}]},"ts":"1689894735183"} 2023-07-20 23:12:15,190 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 23:12:15,192 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 23:12:15,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, UNASSIGN}] 2023-07-20 23:12:15,195 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, UNASSIGN 2023-07-20 23:12:15,195 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, UNASSIGN 2023-07-20 23:12:15,196 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b86896f3069e1f828d29d5ae1f5d8405, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:15,196 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fc529e43de5ccda62bb1233b5714940c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:15,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735196"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894735196"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894735196"}]},"ts":"1689894735196"} 2023-07-20 23:12:15,196 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735196"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894735196"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894735196"}]},"ts":"1689894735196"} 2023-07-20 23:12:15,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure b86896f3069e1f828d29d5ae1f5d8405, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:12:15,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure fc529e43de5ccda62bb1233b5714940c, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:12:15,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 23:12:15,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:15,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b86896f3069e1f828d29d5ae1f5d8405, disabling compactions & flushes 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fc529e43de5ccda62bb1233b5714940c, disabling compactions & flushes 2023-07-20 23:12:15,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:15,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. after waiting 0 ms 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. after waiting 0 ms 2023-07-20 23:12:15,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:15,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:15,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405. 2023-07-20 23:12:15,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b86896f3069e1f828d29d5ae1f5d8405: 2023-07-20 23:12:15,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:15,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c. 2023-07-20 23:12:15,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fc529e43de5ccda62bb1233b5714940c: 2023-07-20 23:12:15,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:15,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b86896f3069e1f828d29d5ae1f5d8405, regionState=CLOSED 2023-07-20 23:12:15,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894735372"}]},"ts":"1689894735372"} 2023-07-20 23:12:15,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:15,373 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fc529e43de5ccda62bb1233b5714940c, regionState=CLOSED 2023-07-20 23:12:15,373 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894735373"}]},"ts":"1689894735373"} 2023-07-20 23:12:15,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-20 23:12:15,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure b86896f3069e1f828d29d5ae1f5d8405, server=jenkins-hbase4.apache.org,46763,1689894621375 in 176 msec 2023-07-20 23:12:15,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-20 23:12:15,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure fc529e43de5ccda62bb1233b5714940c, server=jenkins-hbase4.apache.org,45507,1689894621469 in 175 msec 2023-07-20 23:12:15,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b86896f3069e1f828d29d5ae1f5d8405, UNASSIGN in 190 msec 2023-07-20 23:12:15,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-20 23:12:15,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fc529e43de5ccda62bb1233b5714940c, UNASSIGN in 191 msec 2023-07-20 23:12:15,389 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894735389"}]},"ts":"1689894735389"} 2023-07-20 23:12:15,391 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 23:12:15,392 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 23:12:15,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 215 msec 2023-07-20 23:12:15,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 23:12:15,485 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 23:12:15,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,494 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,496 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,499 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,500 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,500 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,500 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,502 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,502 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,502 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,502 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,502 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,502 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 23:12:15,507 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,507 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,513 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:15,513 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:15,516 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/recovered.edits] 2023-07-20 23:12:15,517 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/recovered.edits] 2023-07-20 23:12:15,523 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf/189bbbdbfa0c47068fe73c6566f74e4f to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/cf/189bbbdbfa0c47068fe73c6566f74e4f 2023-07-20 23:12:15,527 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c/recovered.edits/9.seqid 2023-07-20 23:12:15,527 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/fc529e43de5ccda62bb1233b5714940c 2023-07-20 23:12:15,533 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf/d8f2ce75fab845c198b4af9b31b07621 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/cf/d8f2ce75fab845c198b4af9b31b07621 2023-07-20 23:12:15,537 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405/recovered.edits/9.seqid 2023-07-20 23:12:15,537 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testEmptyExportFileSystemState/b86896f3069e1f828d29d5ae1f5d8405 2023-07-20 23:12:15,538 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 23:12:15,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,544 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 23:12:15,549 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 23:12:15,550 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,550 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 23:12:15,550 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894735550"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:15,550 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894735550"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:15,557 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:12:15,557 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b86896f3069e1f828d29d5ae1f5d8405, NAME => 'testtb-testEmptyExportFileSystemState,,1689894721181.b86896f3069e1f828d29d5ae1f5d8405.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fc529e43de5ccda62bb1233b5714940c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689894721181.fc529e43de5ccda62bb1233b5714940c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:12:15,557 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 23:12:15,557 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894735557"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:15,562 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 23:12:15,564 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 78 msec 2023-07-20 23:12:15,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 23:12:15,605 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 23:12:15,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 23:12:15,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 23:12:15,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,678 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 763) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:52346 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4596 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:33294 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:40229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-692048287_1 at /127.0.0.1:33276 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:44826 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-692048287_1 at /127.0.0.1:52334 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:44005 from appattempt_1689894629575_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 913), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=662 (was 588) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=270 (was 1518) 2023-07-20 23:12:15,678 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 23:12:15,711 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=662, ProcessCount=183, AvailableMemoryMB=269 2023-07-20 23:12:15,711 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-20 23:12:15,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:12:15,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:15,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:12:15,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 23:12:15,733 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:12:15,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:15,737 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:15,737 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:15,738 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb empty. 2023-07-20 23:12:15,739 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f empty. 2023-07-20 23:12:15,739 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:15,739 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:15,739 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 23:12:15,774 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 23:12:15,777 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c5c69c185a34bd1fcc5a0451ab236bb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:12:15,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2234490c9acf8f9e05f9afdb9761473f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp 2023-07-20 23:12:15,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:15,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:15,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 9c5c69c185a34bd1fcc5a0451ab236bb, disabling compactions & flushes 2023-07-20 23:12:15,987 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:15,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:15,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. after waiting 0 ms 2023-07-20 23:12:15,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:15,987 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:15,987 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 9c5c69c185a34bd1fcc5a0451ab236bb: 2023-07-20 23:12:15,991 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:15,991 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 2234490c9acf8f9e05f9afdb9761473f, disabling compactions & flushes 2023-07-20 23:12:15,991 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:15,991 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:15,991 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. after waiting 0 ms 2023-07-20 23:12:15,991 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:15,991 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:15,991 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 2234490c9acf8f9e05f9afdb9761473f: 2023-07-20 23:12:16,001 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:12:16,003 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894736002"}]},"ts":"1689894736002"} 2023-07-20 23:12:16,003 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894736002"}]},"ts":"1689894736002"} 2023-07-20 23:12:16,005 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:12:16,006 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:12:16,006 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894736006"}]},"ts":"1689894736006"} 2023-07-20 23:12:16,007 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 23:12:16,013 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:12:16,014 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:12:16,014 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:12:16,014 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:12:16,014 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:12:16,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, ASSIGN}] 2023-07-20 23:12:16,018 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, ASSIGN 2023-07-20 23:12:16,018 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, ASSIGN 2023-07-20 23:12:16,020 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46763,1689894621375; forceNewPlan=false, retain=false 2023-07-20 23:12:16,020 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45507,1689894621469; forceNewPlan=false, retain=false 2023-07-20 23:12:16,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,170 INFO [jenkins-hbase4:40207] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:12:16,173 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2234490c9acf8f9e05f9afdb9761473f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:16,173 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9c5c69c185a34bd1fcc5a0451ab236bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:16,174 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736173"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894736173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894736173"}]},"ts":"1689894736173"} 2023-07-20 23:12:16,174 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736173"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894736173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894736173"}]},"ts":"1689894736173"} 2023-07-20 23:12:16,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 2234490c9acf8f9e05f9afdb9761473f, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:12:16,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 9c5c69c185a34bd1fcc5a0451ab236bb, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:12:16,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:16,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c5c69c185a34bd1fcc5a0451ab236bb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:12:16,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. service=AccessControlService 2023-07-20 23:12:16,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:16,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2234490c9acf8f9e05f9afdb9761473f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. service=AccessControlService 2023-07-20 23:12:16,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:16,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,335 INFO [StoreOpener-9c5c69c185a34bd1fcc5a0451ab236bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,335 INFO [StoreOpener-2234490c9acf8f9e05f9afdb9761473f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,337 DEBUG [StoreOpener-2234490c9acf8f9e05f9afdb9761473f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf 2023-07-20 23:12:16,337 DEBUG [StoreOpener-2234490c9acf8f9e05f9afdb9761473f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf 2023-07-20 23:12:16,338 INFO [StoreOpener-2234490c9acf8f9e05f9afdb9761473f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2234490c9acf8f9e05f9afdb9761473f columnFamilyName cf 2023-07-20 23:12:16,338 INFO [StoreOpener-2234490c9acf8f9e05f9afdb9761473f-1] regionserver.HStore(310): Store=2234490c9acf8f9e05f9afdb9761473f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:16,339 DEBUG [StoreOpener-9c5c69c185a34bd1fcc5a0451ab236bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf 2023-07-20 23:12:16,339 DEBUG [StoreOpener-9c5c69c185a34bd1fcc5a0451ab236bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf 2023-07-20 23:12:16,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,340 INFO [StoreOpener-9c5c69c185a34bd1fcc5a0451ab236bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c5c69c185a34bd1fcc5a0451ab236bb columnFamilyName cf 2023-07-20 23:12:16,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,341 INFO [StoreOpener-9c5c69c185a34bd1fcc5a0451ab236bb-1] regionserver.HStore(310): Store=9c5c69c185a34bd1fcc5a0451ab236bb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:16,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:16,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:16,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:16,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2234490c9acf8f9e05f9afdb9761473f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66473260, jitterRate=-0.009471237659454346}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2234490c9acf8f9e05f9afdb9761473f: 2023-07-20 23:12:16,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f., pid=108, masterSystemTime=1689894736327 2023-07-20 23:12:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:16,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c5c69c185a34bd1fcc5a0451ab236bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69848103, jitterRate=0.04081784188747406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:16,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c5c69c185a34bd1fcc5a0451ab236bb: 2023-07-20 23:12:16,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:16,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:16,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb., pid=109, masterSystemTime=1689894736328 2023-07-20 23:12:16,365 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2234490c9acf8f9e05f9afdb9761473f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:16,365 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736365"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894736365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894736365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894736365"}]},"ts":"1689894736365"} 2023-07-20 23:12:16,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9c5c69c185a34bd1fcc5a0451ab236bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:16,367 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894736367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894736367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894736367"}]},"ts":"1689894736367"} 2023-07-20 23:12:16,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:16,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:16,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-20 23:12:16,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 2234490c9acf8f9e05f9afdb9761473f, server=jenkins-hbase4.apache.org,46763,1689894621375 in 192 msec 2023-07-20 23:12:16,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-20 23:12:16,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 9c5c69c185a34bd1fcc5a0451ab236bb, server=jenkins-hbase4.apache.org,45507,1689894621469 in 193 msec 2023-07-20 23:12:16,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, ASSIGN in 356 msec 2023-07-20 23:12:16,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-20 23:12:16,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, ASSIGN in 357 msec 2023-07-20 23:12:16,375 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:12:16,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894736375"}]},"ts":"1689894736375"} 2023-07-20 23:12:16,376 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 23:12:16,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:12:16,379 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 23:12:16,381 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 23:12:16,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 672 msec 2023-07-20 23:12:16,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,841 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 23:12:16,841 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-20 23:12:16,842 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:16,862 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-20 23:12:16,863 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:16,863 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-20 23:12:16,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:16,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894736874 (current time:1689894736874). 2023-07-20 23:12:16,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:16,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x3914f79b to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:16,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de25fa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:16,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:16,906 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:16,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3914f79b to 127.0.0.1:51258 2023-07-20 23:12:16,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:16,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x298c6eec to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:16,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@373aec69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:16,924 DEBUG [hconnection-0x180aba63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:16,935 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:16,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:16,944 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:16,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x298c6eec to 127.0.0.1:51258 2023-07-20 23:12:16,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:16,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 23:12:16,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:16,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:16,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:16,954 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:16,955 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689895336955 2023-07-20 23:12:16,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:16,956 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:16,959 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:16,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:16,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-20 23:12:16,962 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:16,963 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689895336963 2023-07-20 23:12:16,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,985 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 23:12:16,985 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:16,987 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 23:12:16,987 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 23:12:17,050 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,050 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,053 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,053 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,053 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,053 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,054 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,054 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,055 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,055 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,058 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,059 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,059 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,059 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,060 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,060 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,058 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,060 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,061 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,061 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,061 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,062 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:17,066 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,066 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,066 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,067 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,068 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,068 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c34c4b4[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:17,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c34c4b4[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:17,073 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 23:12:17,073 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,075 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,075 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:17,075 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:17,075 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. started... 2023-07-20 23:12:17,075 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,076 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,076 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:12:17,075 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. started... 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c5c69c185a34bd1fcc5a0451ab236bb: 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2234490c9acf8f9e05f9afdb9761473f: 2023-07-20 23:12:17,080 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,080 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:17,080 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:17,083 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,083 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,083 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,113 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. completed. 2023-07-20 23:12:17,113 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:17,113 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:17,113 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:17,113 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,113 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,113 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:12:17,115 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,115 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,115 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,115 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,117 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. completed. 2023-07-20 23:12:17,117 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,117 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:12:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,119 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,119 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,119 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,119 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:12:17,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 23:12:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:12:17,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 23:12:17,134 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 23:12:17,134 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:17,134 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:17,134 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,134 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:17,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,139 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,138 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,139 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,140 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,141 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,142 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,143 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,143 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,151 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,151 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,152 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,152 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,152 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,151 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,154 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,152 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,155 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 23:12:17,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689894736956Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894737155 (+199 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894737155Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894737159 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894737185 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689894737222 (+37 ms) 2023-07-20 23:12:17,226 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 268 msec 2023-07-20 23:12:17,263 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:17,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45507] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:17,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46763] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:17,275 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,275 DEBUG [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:17,275 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:17,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:17,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894737286 (current time:1689894737286). 2023-07-20 23:12:17,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:17,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x77f84732 to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:17,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a6c320c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:17,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:17,298 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77f84732 to 127.0.0.1:51258 2023-07-20 23:12:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(139): Connect 0x7f6af4ad to 127.0.0.1:51258 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:17,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a1efda5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:17,315 DEBUG [hconnection-0x11b95ab8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:17,316 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:17,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:17,326 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:17,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f6af4ad to 127.0.0.1:51258 2023-07-20 23:12:17,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:17,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 23:12:17,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:17,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:17,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:17,334 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:17,335 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689895337335 2023-07-20 23:12:17,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:17,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,337 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:17,337 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:17,338 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:17,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-20 23:12:17,340 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,341 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689895337341 2023-07-20 23:12:17,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,361 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 23:12:17,361 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,362 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 23:12:17,363 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 23:12:17,363 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,363 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,365 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,365 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,365 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,365 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,365 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,366 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,366 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,366 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:17,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 23:12:17,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,367 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,368 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 23:12:17,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,368 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,368 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 23:12:17,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,369 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,376 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,376 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,376 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,377 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,377 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,376 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,378 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,378 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,379 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,379 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,379 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45475,1689894621544' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,379 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,378 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,382 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,383 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,384 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,384 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45507,1689894621469' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a1963c2[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46763,1689894621375' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:17,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a1963c2[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:17,388 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 23:12:17,388 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,396 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,396 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,396 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,396 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45475,1689894621544' in zk 2023-07-20 23:12:17,397 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,397 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:17,398 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,398 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,398 DEBUG [member: 'jenkins-hbase4.apache.org,45475,1689894621544' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:17,406 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:17,408 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:17,408 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:17,408 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:17,408 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. started... 2023-07-20 23:12:17,408 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. started... 2023-07-20 23:12:17,408 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c5c69c185a34bd1fcc5a0451ab236bb 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 23:12:17,408 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2234490c9acf8f9e05f9afdb9761473f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 23:12:17,437 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,439 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:17,514 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/.tmp/cf/eeb8fb0517bc47ee84ea21fa34411f9a 2023-07-20 23:12:17,522 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/.tmp/cf/5e064f23027c432488eecbacae701196 2023-07-20 23:12:17,530 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/.tmp/cf/eeb8fb0517bc47ee84ea21fa34411f9a as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf/eeb8fb0517bc47ee84ea21fa34411f9a 2023-07-20 23:12:17,540 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/.tmp/cf/5e064f23027c432488eecbacae701196 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf/5e064f23027c432488eecbacae701196 2023-07-20 23:12:17,547 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf/5e064f23027c432488eecbacae701196, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 23:12:17,550 INFO [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9c5c69c185a34bd1fcc5a0451ab236bb in 142ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:17,551 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 23:12:17,553 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf/eeb8fb0517bc47ee84ea21fa34411f9a, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 23:12:17,553 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c5c69c185a34bd1fcc5a0451ab236bb: 2023-07-20 23:12:17,553 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,554 INFO [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2234490c9acf8f9e05f9afdb9761473f in 146ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:17,555 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:17,558 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf/5e064f23027c432488eecbacae701196] hfiles 2023-07-20 23:12:17,558 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf/5e064f23027c432488eecbacae701196 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,558 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2234490c9acf8f9e05f9afdb9761473f: 2023-07-20 23:12:17,558 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,558 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:17,559 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf/eeb8fb0517bc47ee84ea21fa34411f9a] hfiles 2023-07-20 23:12:17,559 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf/eeb8fb0517bc47ee84ea21fa34411f9a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,603 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. completed. 2023-07-20 23:12:17,603 DEBUG [rs(jenkins-hbase4.apache.org,46763,1689894621375)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:17,603 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:17,603 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:17,603 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,603 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,603 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46763,1689894621375' in zk 2023-07-20 23:12:17,606 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. completed. 2023-07-20 23:12:17,606 DEBUG [rs(jenkins-hbase4.apache.org,45507,1689894621469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:17,606 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:17,606 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:17,606 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,606 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,606 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45507,1689894621469' in zk 2023-07-20 23:12:17,607 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,607 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,607 DEBUG [member: 'jenkins-hbase4.apache.org,46763,1689894621375' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,609 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,611 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,611 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,611 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,611 DEBUG [member: 'jenkins-hbase4.apache.org,45507,1689894621469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46763,1689894621375': 2023-07-20 23:12:17,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46763,1689894621375' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 23:12:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45507,1689894621469': 2023-07-20 23:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45507,1689894621469' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 23:12:17,628 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 23:12:17,629 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:17,629 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:17,629 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,629 INFO [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,631 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,632 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,633 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,634 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,636 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,637 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,637 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,639 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,641 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,641 DEBUG [(jenkins-hbase4.apache.org,40207,1689894619668)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-20 23:12:17,641 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,645 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,941 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,942 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:12:18,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 23:12:18,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:18,219 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:18,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689894737335Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737643 (+308 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737644 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737650 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737731 (+81 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689894738218 (+487 ms) 2023-07-20 23:12:18,223 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:18,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 886 msec 2023-07-20 23:12:18,442 DEBUG [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:18,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:18,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:18,444 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444 2023-07-20 23:12:18,444 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33785, tgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444, rawTgtDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444, srcFsUri=hdfs://localhost:33785, srcDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:12:18,479 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d 2023-07-20 23:12:18,479 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_980082124_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:18,479 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33785, inputRoot=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d, snapshotDir=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 23:12:18,504 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:18,569 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,570 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,571 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,571 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,572 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,572 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,575 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,675 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/hadoop-8685097282708923004.jar 2023-07-20 23:12:18,676 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,677 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,677 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,677 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,678 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,678 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,679 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:12:18,680 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:12:18,680 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:12:18,681 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:12:18,681 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:12:18,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:12:18,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:12:18,683 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:12:18,683 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:12:18,684 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:12:18,685 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,685 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,686 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:18,686 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,686 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,687 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:18,688 DEBUG [Listener at jenkins-hbase4.apache.org/36627] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:19,363 WARN [Listener at jenkins-hbase4.apache.org/36627] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:12:19,365 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 23:12:19,367 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 23:12:20,114 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:20,114 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:20,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0006_000001 (auth:SIMPLE) 2023-07-20 23:12:20,135 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:20,989 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:12:25,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:27,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:33,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:34,622 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:12:34,622 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:12:34,656 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,656 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:12:34,657 INFO [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:12:34,657 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,658 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 23:12:34,658 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 23:12:34,658 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_683386998_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,660 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 23:12:34,660 DEBUG [Listener at jenkins-hbase4.apache.org/36627] snapshot.TestExportSnapshot(367): hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/export-test/export-1689894738444/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 23:12:34,678 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 23:12:34,686 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894754686"}]},"ts":"1689894754686"} 2023-07-20 23:12:34,687 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 23:12:34,689 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 23:12:34,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, UNASSIGN}] 2023-07-20 23:12:34,692 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, UNASSIGN 2023-07-20 23:12:34,692 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, UNASSIGN 2023-07-20 23:12:34,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9c5c69c185a34bd1fcc5a0451ab236bb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:12:34,693 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2234490c9acf8f9e05f9afdb9761473f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:12:34,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894754693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894754693"}]},"ts":"1689894754693"} 2023-07-20 23:12:34,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894754693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894754693"}]},"ts":"1689894754693"} 2023-07-20 23:12:34,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 9c5c69c185a34bd1fcc5a0451ab236bb, server=jenkins-hbase4.apache.org,45507,1689894621469}] 2023-07-20 23:12:34,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 2234490c9acf8f9e05f9afdb9761473f, server=jenkins-hbase4.apache.org,46763,1689894621375}] 2023-07-20 23:12:34,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 23:12:34,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c5c69c185a34bd1fcc5a0451ab236bb, disabling compactions & flushes 2023-07-20 23:12:34,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. after waiting 0 ms 2023-07-20 23:12:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:34,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2234490c9acf8f9e05f9afdb9761473f, disabling compactions & flushes 2023-07-20 23:12:34,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. after waiting 0 ms 2023-07-20 23:12:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:34,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:34,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:34,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:34,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:34,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb. 2023-07-20 23:12:34,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f. 2023-07-20 23:12:34,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c5c69c185a34bd1fcc5a0451ab236bb: 2023-07-20 23:12:34,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2234490c9acf8f9e05f9afdb9761473f: 2023-07-20 23:12:34,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:34,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2234490c9acf8f9e05f9afdb9761473f, regionState=CLOSED 2023-07-20 23:12:34,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894754867"}]},"ts":"1689894754867"} 2023-07-20 23:12:34,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:34,868 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9c5c69c185a34bd1fcc5a0451ab236bb, regionState=CLOSED 2023-07-20 23:12:34,868 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894754868"}]},"ts":"1689894754868"} 2023-07-20 23:12:34,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-20 23:12:34,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 2234490c9acf8f9e05f9afdb9761473f, server=jenkins-hbase4.apache.org,46763,1689894621375 in 173 msec 2023-07-20 23:12:34,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-20 23:12:34,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 9c5c69c185a34bd1fcc5a0451ab236bb, server=jenkins-hbase4.apache.org,45507,1689894621469 in 175 msec 2023-07-20 23:12:34,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2234490c9acf8f9e05f9afdb9761473f, UNASSIGN in 181 msec 2023-07-20 23:12:34,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-20 23:12:34,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c5c69c185a34bd1fcc5a0451ab236bb, UNASSIGN in 181 msec 2023-07-20 23:12:34,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894754873"}]},"ts":"1689894754873"} 2023-07-20 23:12:34,874 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 23:12:34,876 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 23:12:34,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-20 23:12:34,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 23:12:34,987 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 23:12:34,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,992 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,993 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45507] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,996 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:34,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,996 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:34,996 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,998 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/recovered.edits] 2023-07-20 23:12:34,998 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf, FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/recovered.edits] 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,999 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:35,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 23:12:35,002 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf/5e064f23027c432488eecbacae701196 to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/cf/5e064f23027c432488eecbacae701196 2023-07-20 23:12:35,002 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf/eeb8fb0517bc47ee84ea21fa34411f9a to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/cf/eeb8fb0517bc47ee84ea21fa34411f9a 2023-07-20 23:12:35,005 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb/recovered.edits/9.seqid 2023-07-20 23:12:35,005 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/recovered.edits/9.seqid to hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f/recovered.edits/9.seqid 2023-07-20 23:12:35,005 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c5c69c185a34bd1fcc5a0451ab236bb 2023-07-20 23:12:35,005 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2234490c9acf8f9e05f9afdb9761473f 2023-07-20 23:12:35,005 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 23:12:35,007 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:35,009 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 23:12:35,011 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 23:12:35,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:35,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 23:12:35,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894755012"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:35,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894755012"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:35,013 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:12:35,014 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c5c69c185a34bd1fcc5a0451ab236bb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689894735713.9c5c69c185a34bd1fcc5a0451ab236bb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2234490c9acf8f9e05f9afdb9761473f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894735713.2234490c9acf8f9e05f9afdb9761473f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:12:35,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 23:12:35,014 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894755014"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:35,015 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 23:12:35,017 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:35,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 29 msec 2023-07-20 23:12:35,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 23:12:35,102 INFO [Listener at jenkins-hbase4.apache.org/36627] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 23:12:35,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 23:12:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:35,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 23:12:35,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:35,138 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 764) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1867989603_1 at /127.0.0.1:35338 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1175795369_17 at /127.0.0.1:43804 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:59318 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:39103 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5203 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1867989603_1 at /127.0.0.1:43784 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_683386998_17 at /127.0.0.1:35362 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2ee570c2-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=734 (was 662) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 183), AvailableMemoryMB=1333 (was 269) - AvailableMemoryMB LEAK? - 2023-07-20 23:12:35,138 WARN [Listener at jenkins-hbase4.apache.org/36627] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-20 23:12:35,138 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 23:12:35,149 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:12:39,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629575_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:40,444 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:12:49,277 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:13:03,409 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 23:13:03,410 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:13:03,541 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 23:13:03,563 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 23:13:03,564 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 23:13:03,577 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:13:03,681 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 23:13:03,681 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 23:13:03,681 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 23:13:03,681 INFO [Listener at jenkins-hbase4.apache.org/36627] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 23:13:03,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b7ca875 to 127.0.0.1:51258 2023-07-20 23:13:03,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 23:13:03,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] util.JVMClusterUtil(257): Found active master hash=1556229407, stopped=false 2023-07-20 23:13:03,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,682 DEBUG [Listener at jenkins-hbase4.apache.org/36627] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 23:13:03,682 INFO [Listener at jenkins-hbase4.apache.org/36627] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:13:03,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,688 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:13:03,688 INFO [Listener at jenkins-hbase4.apache.org/36627] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 23:13:03,688 DEBUG [Listener at jenkins-hbase4.apache.org/36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x169fe17c to 127.0.0.1:51258 2023-07-20 23:13:03,688 DEBUG [Listener at jenkins-hbase4.apache.org/36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,689 INFO [Listener at jenkins-hbase4.apache.org/36627] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46763,1689894621375' ***** 2023-07-20 23:13:03,689 DEBUG [Listener at jenkins-hbase4.apache.org/36627] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,689 INFO [Listener at jenkins-hbase4.apache.org/36627] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 23:13:03,689 INFO [Listener at jenkins-hbase4.apache.org/36627] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45507,1689894621469' ***** 2023-07-20 23:13:03,689 DEBUG [Listener at jenkins-hbase4.apache.org/36627] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,689 INFO [RS:0;jenkins-hbase4:46763] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 23:13:03,689 INFO [RS:0;jenkins-hbase4:46763] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 23:13:03,689 INFO [Listener at jenkins-hbase4.apache.org/36627] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 23:13:03,690 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 23:13:03,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,689 INFO [RS:0;jenkins-hbase4:46763] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 23:13:03,690 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:13:03,690 DEBUG [RS:0;jenkins-hbase4:46763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2104a1e3 to 127.0.0.1:51258 2023-07-20 23:13:03,690 DEBUG [RS:0;jenkins-hbase4:46763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,690 INFO [RS:1;jenkins-hbase4:45507] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 23:13:03,690 INFO [Listener at jenkins-hbase4.apache.org/36627] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45475,1689894621544' ***** 2023-07-20 23:13:03,693 INFO [RS:1;jenkins-hbase4:45507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 23:13:03,693 DEBUG [Listener at jenkins-hbase4.apache.org/36627] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,693 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 23:13:03,693 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 23:13:03,693 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46763,1689894621375; all regions closed. 2023-07-20 23:13:03,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,693 INFO [Listener at jenkins-hbase4.apache.org/36627] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 23:13:03,693 INFO [RS:1;jenkins-hbase4:45507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 23:13:03,694 INFO [RS:2;jenkins-hbase4:45475] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 23:13:03,694 INFO [RS:2;jenkins-hbase4:45475] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 23:13:03,694 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(3305): Received CLOSE for 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:13:03,694 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:13:03,695 DEBUG [RS:1;jenkins-hbase4:45507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15cedc5d to 127.0.0.1:51258 2023-07-20 23:13:03,694 INFO [RS:2;jenkins-hbase4:45475] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 23:13:03,695 DEBUG [RS:1;jenkins-hbase4:45507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0262943a33a8079e80aefcb02d76842b, disabling compactions & flushes 2023-07-20 23:13:03,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:13:03,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:13:03,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. after waiting 0 ms 2023-07-20 23:13:03,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:13:03,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0262943a33a8079e80aefcb02d76842b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 23:13:03,705 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 23:13:03,705 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(3305): Received CLOSE for 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:13:03,705 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:13:03,705 DEBUG [RS:2;jenkins-hbase4:45475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65167251 to 127.0.0.1:51258 2023-07-20 23:13:03,705 DEBUG [RS:2;jenkins-hbase4:45475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,705 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1478): Online Regions={0262943a33a8079e80aefcb02d76842b=hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b.} 2023-07-20 23:13:03,718 DEBUG [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1504): Waiting on 0262943a33a8079e80aefcb02d76842b 2023-07-20 23:13:03,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 559280f842828188e4bcdf062a2dfcd8, disabling compactions & flushes 2023-07-20 23:13:03,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:13:03,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:13:03,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. after waiting 0 ms 2023-07-20 23:13:03,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:13:03,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 559280f842828188e4bcdf062a2dfcd8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 23:13:03,723 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,723 INFO [RS:2;jenkins-hbase4:45475] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 23:13:03,723 INFO [RS:2;jenkins-hbase4:45475] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 23:13:03,723 INFO [RS:2;jenkins-hbase4:45475] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 23:13:03,724 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 23:13:03,726 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-20 23:13:03,731 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,733 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1478): Online Regions={559280f842828188e4bcdf062a2dfcd8=hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8., 1588230740=hbase:meta,,1.1588230740} 2023-07-20 23:13:03,734 DEBUG [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1504): Waiting on 1588230740, 559280f842828188e4bcdf062a2dfcd8 2023-07-20 23:13:03,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 23:13:03,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 23:13:03,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 23:13:03,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 23:13:03,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 23:13:03,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 23:13:03,758 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,759 DEBUG [RS:0;jenkins-hbase4:46763] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs 2023-07-20 23:13:03,760 INFO [RS:0;jenkins-hbase4:46763] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46763%2C1689894621375:(num 1689894623796) 2023-07-20 23:13:03,760 DEBUG [RS:0;jenkins-hbase4:46763] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,761 INFO [RS:0;jenkins-hbase4:46763] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,761 INFO [RS:0;jenkins-hbase4:46763] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 23:13:03,762 INFO [RS:0;jenkins-hbase4:46763] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 23:13:03,762 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:03,762 INFO [RS:0;jenkins-hbase4:46763] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 23:13:03,762 INFO [RS:0;jenkins-hbase4:46763] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 23:13:03,764 INFO [RS:0;jenkins-hbase4:46763] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46763 2023-07-20 23:13:03,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/.tmp/info/41c173b65f9942f68fbbe91631e9e5ca 2023-07-20 23:13:03,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/.tmp/l/4d1c056f175d4b7d9719aa919ecca197 2023-07-20 23:13:03,775 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:13:03,776 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,776 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:13:03,776 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,777 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,777 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46763,1689894621375 2023-07-20 23:13:03,777 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,778 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46763,1689894621375] 2023-07-20 23:13:03,779 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46763,1689894621375; numProcessing=1 2023-07-20 23:13:03,781 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46763,1689894621375 already deleted, retry=false 2023-07-20 23:13:03,781 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46763,1689894621375 expired; onlineServers=2 2023-07-20 23:13:03,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/.tmp/info/b5951c6b9c0747a4ab6778fa2b6ceaca 2023-07-20 23:13:03,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d1c056f175d4b7d9719aa919ecca197 2023-07-20 23:13:03,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/.tmp/l/4d1c056f175d4b7d9719aa919ecca197 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/l/4d1c056f175d4b7d9719aa919ecca197 2023-07-20 23:13:03,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/.tmp/info/41c173b65f9942f68fbbe91631e9e5ca as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/info/41c173b65f9942f68fbbe91631e9e5ca 2023-07-20 23:13:03,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5951c6b9c0747a4ab6778fa2b6ceaca 2023-07-20 23:13:03,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d1c056f175d4b7d9719aa919ecca197 2023-07-20 23:13:03,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/l/4d1c056f175d4b7d9719aa919ecca197, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 23:13:03,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0262943a33a8079e80aefcb02d76842b in 87ms, sequenceid=18, compaction requested=false 2023-07-20 23:13:03,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/info/41c173b65f9942f68fbbe91631e9e5ca, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 23:13:03,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 559280f842828188e4bcdf062a2dfcd8 in 74ms, sequenceid=6, compaction requested=false 2023-07-20 23:13:03,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/acl/0262943a33a8079e80aefcb02d76842b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 23:13:03,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/namespace/559280f842828188e4bcdf062a2dfcd8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:13:03,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:13:03,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0262943a33a8079e80aefcb02d76842b: 2023-07-20 23:13:03,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689894625398.0262943a33a8079e80aefcb02d76842b. 2023-07-20 23:13:03,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:13:03,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 559280f842828188e4bcdf062a2dfcd8: 2023-07-20 23:13:03,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689894624544.559280f842828188e4bcdf062a2dfcd8. 2023-07-20 23:13:03,830 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/.tmp/rep_barrier/00ccd032872b45e3a096887c8d5ad38a 2023-07-20 23:13:03,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00ccd032872b45e3a096887c8d5ad38a 2023-07-20 23:13:03,848 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/.tmp/table/8c94b1e0eb764059b4e73ea90962efc0 2023-07-20 23:13:03,852 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c94b1e0eb764059b4e73ea90962efc0 2023-07-20 23:13:03,853 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/.tmp/info/b5951c6b9c0747a4ab6778fa2b6ceaca as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/info/b5951c6b9c0747a4ab6778fa2b6ceaca 2023-07-20 23:13:03,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5951c6b9c0747a4ab6778fa2b6ceaca 2023-07-20 23:13:03,858 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/info/b5951c6b9c0747a4ab6778fa2b6ceaca, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 23:13:03,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/.tmp/rep_barrier/00ccd032872b45e3a096887c8d5ad38a as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/rep_barrier/00ccd032872b45e3a096887c8d5ad38a 2023-07-20 23:13:03,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00ccd032872b45e3a096887c8d5ad38a 2023-07-20 23:13:03,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/rep_barrier/00ccd032872b45e3a096887c8d5ad38a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 23:13:03,864 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/.tmp/table/8c94b1e0eb764059b4e73ea90962efc0 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/table/8c94b1e0eb764059b4e73ea90962efc0 2023-07-20 23:13:03,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c94b1e0eb764059b4e73ea90962efc0 2023-07-20 23:13:03,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/table/8c94b1e0eb764059b4e73ea90962efc0, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 23:13:03,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 116ms, sequenceid=131, compaction requested=false 2023-07-20 23:13:03,879 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,879 INFO [RS:0;jenkins-hbase4:46763] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46763,1689894621375; zookeeper connection closed. 2023-07-20 23:13:03,879 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:46763-0x101850009440001, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,879 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@661e3dbd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@661e3dbd 2023-07-20 23:13:03,881 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 23:13:03,882 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,882 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 23:13:03,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 23:13:03,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 23:13:03,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 23:13:03,918 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45507,1689894621469; all regions closed. 2023-07-20 23:13:03,929 DEBUG [RS:1;jenkins-hbase4:45507] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs 2023-07-20 23:13:03,929 INFO [RS:1;jenkins-hbase4:45507] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45507%2C1689894621469:(num 1689894623795) 2023-07-20 23:13:03,929 DEBUG [RS:1;jenkins-hbase4:45507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,929 INFO [RS:1;jenkins-hbase4:45507] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,929 INFO [RS:1;jenkins-hbase4:45507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 23:13:03,930 INFO [RS:1;jenkins-hbase4:45507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 23:13:03,930 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:03,930 INFO [RS:1;jenkins-hbase4:45507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 23:13:03,931 INFO [RS:1;jenkins-hbase4:45507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 23:13:03,931 INFO [RS:1;jenkins-hbase4:45507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45507 2023-07-20 23:13:03,933 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:13:03,933 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45507,1689894621469 2023-07-20 23:13:03,933 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,934 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45475,1689894621544; all regions closed. 2023-07-20 23:13:03,935 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45507,1689894621469] 2023-07-20 23:13:03,935 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45507,1689894621469; numProcessing=2 2023-07-20 23:13:03,940 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45507,1689894621469 already deleted, retry=false 2023-07-20 23:13:03,941 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45507,1689894621469 expired; onlineServers=1 2023-07-20 23:13:03,951 DEBUG [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs 2023-07-20 23:13:03,951 INFO [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45475%2C1689894621544.meta:.meta(num 1689894624121) 2023-07-20 23:13:03,969 DEBUG [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/oldWALs 2023-07-20 23:13:03,969 INFO [RS:2;jenkins-hbase4:45475] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45475%2C1689894621544:(num 1689894623797) 2023-07-20 23:13:03,969 DEBUG [RS:2;jenkins-hbase4:45475] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,969 INFO [RS:2;jenkins-hbase4:45475] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,969 INFO [RS:2;jenkins-hbase4:45475] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 23:13:03,969 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:03,971 INFO [RS:2;jenkins-hbase4:45475] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45475 2023-07-20 23:13:03,975 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,975 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45475,1689894621544 2023-07-20 23:13:03,978 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45475,1689894621544] 2023-07-20 23:13:03,978 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45475,1689894621544; numProcessing=3 2023-07-20 23:13:03,980 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45475,1689894621544 already deleted, retry=false 2023-07-20 23:13:03,980 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45475,1689894621544 expired; onlineServers=0 2023-07-20 23:13:03,980 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40207,1689894619668' ***** 2023-07-20 23:13:03,980 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 23:13:03,980 DEBUG [M:0;jenkins-hbase4:40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dff2724, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:13:03,980 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40207,1689894619668 2023-07-20 23:13:03,980 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40207,1689894619668; all regions closed. 2023-07-20 23:13:03,980 DEBUG [M:0;jenkins-hbase4:40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,980 DEBUG [M:0;jenkins-hbase4:40207] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 23:13:03,980 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 23:13:03,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689894623259] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689894623259,5,FailOnTimeoutGroup] 2023-07-20 23:13:03,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689894623258] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689894623258,5,FailOnTimeoutGroup] 2023-07-20 23:13:03,980 DEBUG [M:0;jenkins-hbase4:40207] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 23:13:03,981 INFO [M:0;jenkins-hbase4:40207] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 23:13:03,981 INFO [M:0;jenkins-hbase4:40207] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 23:13:03,981 INFO [M:0;jenkins-hbase4:40207] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 23:13:03,981 DEBUG [M:0;jenkins-hbase4:40207] master.HMaster(1512): Stopping service threads 2023-07-20 23:13:03,981 INFO [M:0;jenkins-hbase4:40207] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 23:13:03,982 ERROR [M:0;jenkins-hbase4:40207] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 23:13:03,982 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 23:13:03,982 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:13:03,982 INFO [M:0;jenkins-hbase4:40207] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 23:13:03,982 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 23:13:03,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:13:03,983 DEBUG [M:0;jenkins-hbase4:40207] zookeeper.ZKUtil(398): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-20 23:13:03,983 WARN [M:0;jenkins-hbase4:40207] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-20 23:13:03,983 INFO [M:0;jenkins-hbase4:40207] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 23:13:03,983 INFO [M:0;jenkins-hbase4:40207] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 23:13:03,984 DEBUG [M:0;jenkins-hbase4:40207] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 23:13:03,984 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:03,984 DEBUG [M:0;jenkins-hbase4:40207] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:03,984 DEBUG [M:0;jenkins-hbase4:40207] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 23:13:03,984 DEBUG [M:0;jenkins-hbase4:40207] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:03,984 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.14 KB heapSize=449.37 KB 2023-07-20 23:13:04,007 INFO [M:0;jenkins-hbase4:40207] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.14 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7b42b661f33f4e67877163afa0294ff8 2023-07-20 23:13:04,012 INFO [M:0;jenkins-hbase4:40207] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b42b661f33f4e67877163afa0294ff8 2023-07-20 23:13:04,013 DEBUG [M:0;jenkins-hbase4:40207] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7b42b661f33f4e67877163afa0294ff8 as hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7b42b661f33f4e67877163afa0294ff8 2023-07-20 23:13:04,021 INFO [M:0;jenkins-hbase4:40207] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b42b661f33f4e67877163afa0294ff8 2023-07-20 23:13:04,021 INFO [M:0;jenkins-hbase4:40207] regionserver.HStore(1080): Added hdfs://localhost:33785/user/jenkins/test-data/51b6466f-1084-70f4-58dc-9b48aca6258d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7b42b661f33f4e67877163afa0294ff8, entries=119, sequenceid=899, filesize=28.4 K 2023-07-20 23:13:04,022 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegion(2948): Finished flush of dataSize ~373.14 KB/382099, heapSize ~449.35 KB/460136, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=899, compaction requested=false 2023-07-20 23:13:04,024 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:04,024 DEBUG [M:0;jenkins-hbase4:40207] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 23:13:04,031 INFO [M:0;jenkins-hbase4:40207] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 23:13:04,031 INFO [M:0;jenkins-hbase4:40207] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40207 2023-07-20 23:13:04,031 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:04,033 DEBUG [M:0;jenkins-hbase4:40207] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40207,1689894619668 already deleted, retry=false 2023-07-20 23:13:04,036 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,036 INFO [RS:1;jenkins-hbase4:45507] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45507,1689894621469; zookeeper connection closed. 2023-07-20 23:13:04,036 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45507-0x101850009440002, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,037 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@27c917f2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@27c917f2 2023-07-20 23:13:04,136 INFO [M:0;jenkins-hbase4:40207] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40207,1689894619668; zookeeper connection closed. 2023-07-20 23:13:04,136 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,136 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): master:40207-0x101850009440000, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,236 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,236 INFO [RS:2;jenkins-hbase4:45475] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45475,1689894621544; zookeeper connection closed. 2023-07-20 23:13:04,236 DEBUG [Listener at localhost/42615-EventThread] zookeeper.ZKWatcher(600): regionserver:45475-0x101850009440003, quorum=127.0.0.1:51258, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,236 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@62b0feb5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@62b0feb5 2023-07-20 23:13:04,237 INFO [Listener at jenkins-hbase4.apache.org/36627] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 23:13:04,237 WARN [Listener at jenkins-hbase4.apache.org/36627] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 23:13:04,248 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,354 WARN [BP-1638220986-172.31.14.131-1689894615380 heartbeating to localhost/127.0.0.1:33785] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 23:13:04,354 WARN [BP-1638220986-172.31.14.131-1689894615380 heartbeating to localhost/127.0.0.1:33785] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1638220986-172.31.14.131-1689894615380 (Datanode Uuid 6c098bcf-888c-4c53-8fa0-765aa8dae29a) service to localhost/127.0.0.1:33785 2023-07-20 23:13:04,356 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data5/current/BP-1638220986-172.31.14.131-1689894615380] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,357 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data6/current/BP-1638220986-172.31.14.131-1689894615380] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,378 WARN [Listener at jenkins-hbase4.apache.org/36627] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 23:13:04,383 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,392 WARN [BP-1638220986-172.31.14.131-1689894615380 heartbeating to localhost/127.0.0.1:33785] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 23:13:04,392 WARN [BP-1638220986-172.31.14.131-1689894615380 heartbeating to localhost/127.0.0.1:33785] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1638220986-172.31.14.131-1689894615380 (Datanode Uuid d47c2b68-5c85-4d8f-9dff-519aa096ec83) service to localhost/127.0.0.1:33785 2023-07-20 23:13:04,392 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data3/current/BP-1638220986-172.31.14.131-1689894615380] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,393 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data4/current/BP-1638220986-172.31.14.131-1689894615380] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,394 WARN [Listener at jenkins-hbase4.apache.org/36627] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 23:13:04,398 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,502 WARN [BP-1638220986-172.31.14.131-1689894615380 heartbeating to localhost/127.0.0.1:33785] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 23:13:04,502 WARN [BP-1638220986-172.31.14.131-1689894615380 heartbeating to localhost/127.0.0.1:33785] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1638220986-172.31.14.131-1689894615380 (Datanode Uuid 1035b865-a9e7-4629-9f26-e578ebc21c3e) service to localhost/127.0.0.1:33785 2023-07-20 23:13:04,504 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data2/current/BP-1638220986-172.31.14.131-1689894615380] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,506 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efee5d96-f9c1-2929-3113-993b9f1bb8e8/cluster_e32ef533-9b3f-1649-cdb0-6f479f2ebdf4/dfs/data/data1/current/BP-1638220986-172.31.14.131-1689894615380] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,544 INFO [Listener at jenkins-hbase4.apache.org/36627] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,681 INFO [Listener at jenkins-hbase4.apache.org/36627] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 23:13:04,794 INFO [Listener at jenkins-hbase4.apache.org/36627] hbase.HBaseTestingUtility(1293): Minicluster is down