2023-07-12 14:36:00,164 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 14:36:00,428 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2 2023-07-12 14:36:00,428 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 14:36:00,428 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 14:36:00,481 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 14:36:00,779 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 14:36:00,779 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303, deleteOnExit=true 2023-07-12 14:36:00,780 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 14:36:00,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/test.cache.data in system properties and HBase conf 2023-07-12 14:36:00,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 14:36:00,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop.log.dir in system properties and HBase conf 2023-07-12 14:36:00,782 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 14:36:00,782 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 14:36:00,783 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 14:36:01,164 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 14:36:01,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 14:36:01,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 14:36:01,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 14:36:01,169 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 14:36:01,170 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 14:36:01,170 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 14:36:01,171 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 14:36:01,171 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 14:36:01,171 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 14:36:01,172 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/nfs.dump.dir in system properties and HBase conf 2023-07-12 14:36:01,172 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir in system properties and HBase conf 2023-07-12 14:36:01,172 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 14:36:01,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 14:36:01,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 14:36:02,048 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 14:36:02,055 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 14:36:02,506 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 14:36:02,745 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 14:36:02,784 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:02,824 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:02,861 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_localhost_localdomain_44581_hdfs____.7q5394/webapp 2023-07-12 14:36:03,000 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:44581 2023-07-12 14:36:03,057 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 14:36:03,058 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 14:36:03,698 WARN [Listener at localhost.localdomain/36845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 14:36:03,817 WARN [Listener at localhost.localdomain/36845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 14:36:03,847 WARN [Listener at localhost.localdomain/36845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:03,856 INFO [Listener at localhost.localdomain/36845] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:03,865 INFO [Listener at localhost.localdomain/36845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_localhost_39735_datanode____.v2y9ye/webapp 2023-07-12 14:36:03,982 INFO [Listener at localhost.localdomain/36845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39735 2023-07-12 14:36:04,501 WARN [Listener at localhost.localdomain/36251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 14:36:04,527 WARN [Listener at localhost.localdomain/36251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 14:36:04,531 WARN [Listener at localhost.localdomain/36251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:04,534 INFO [Listener at localhost.localdomain/36251] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:04,542 INFO [Listener at localhost.localdomain/36251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_localhost_46053_datanode____.munf2l/webapp 2023-07-12 14:36:04,648 INFO [Listener at localhost.localdomain/36251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46053 2023-07-12 14:36:04,668 WARN [Listener at localhost.localdomain/45841] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 14:36:04,718 WARN [Listener at localhost.localdomain/45841] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 14:36:04,724 WARN [Listener at localhost.localdomain/45841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:04,726 INFO [Listener at localhost.localdomain/45841] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:04,737 INFO [Listener at localhost.localdomain/45841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_localhost_42929_datanode____i6quw9/webapp 2023-07-12 14:36:04,885 INFO [Listener at localhost.localdomain/45841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42929 2023-07-12 14:36:04,918 WARN [Listener at localhost.localdomain/40419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 14:36:05,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bc1462caead1eea: Processing first storage report for DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83 from datanode 02200306-68d2-4e47-99a2-5f3f0e8af6bc 2023-07-12 14:36:05,396 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bc1462caead1eea: from storage DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83 node DatanodeRegistration(127.0.0.1:36877, datanodeUuid=02200306-68d2-4e47-99a2-5f3f0e8af6bc, infoPort=43995, infoSecurePort=0, ipcPort=40419, storageInfo=lv=-57;cid=testClusterID;nsid=853678551;c=1689172562208), blocks: 0, hasStaleStorage: true, processing time: 4 msecs, invalidatedBlocks: 0 2023-07-12 14:36:05,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9e3b4af0e24119cc: Processing first storage report for DS-8dfac479-61f8-41aa-819d-54f6bba05e5c from datanode 9a9c268d-88e0-4bc1-a254-3277b28b8ad0 2023-07-12 14:36:05,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9e3b4af0e24119cc: from storage DS-8dfac479-61f8-41aa-819d-54f6bba05e5c node DatanodeRegistration(127.0.0.1:33445, datanodeUuid=9a9c268d-88e0-4bc1-a254-3277b28b8ad0, infoPort=38151, infoSecurePort=0, ipcPort=45841, storageInfo=lv=-57;cid=testClusterID;nsid=853678551;c=1689172562208), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 14:36:05,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7eff7bf6e7715d2a: Processing first storage report for DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991 from datanode f72d87d5-ee99-48d6-b1b3-dc081a94ff4f 2023-07-12 14:36:05,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7eff7bf6e7715d2a: from storage DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991 node DatanodeRegistration(127.0.0.1:46153, datanodeUuid=f72d87d5-ee99-48d6-b1b3-dc081a94ff4f, infoPort=42045, infoSecurePort=0, ipcPort=36251, storageInfo=lv=-57;cid=testClusterID;nsid=853678551;c=1689172562208), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 14:36:05,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bc1462caead1eea: Processing first storage report for DS-d5128f67-8cfc-4537-b80b-cdf08e5c87f1 from datanode 02200306-68d2-4e47-99a2-5f3f0e8af6bc 2023-07-12 14:36:05,397 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bc1462caead1eea: from storage DS-d5128f67-8cfc-4537-b80b-cdf08e5c87f1 node DatanodeRegistration(127.0.0.1:36877, datanodeUuid=02200306-68d2-4e47-99a2-5f3f0e8af6bc, infoPort=43995, infoSecurePort=0, ipcPort=40419, storageInfo=lv=-57;cid=testClusterID;nsid=853678551;c=1689172562208), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 14:36:05,398 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9e3b4af0e24119cc: Processing first storage report for DS-164ef159-8bff-4e55-9bea-4e9b5a8383b6 from datanode 9a9c268d-88e0-4bc1-a254-3277b28b8ad0 2023-07-12 14:36:05,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9e3b4af0e24119cc: from storage DS-164ef159-8bff-4e55-9bea-4e9b5a8383b6 node DatanodeRegistration(127.0.0.1:33445, datanodeUuid=9a9c268d-88e0-4bc1-a254-3277b28b8ad0, infoPort=38151, infoSecurePort=0, ipcPort=45841, storageInfo=lv=-57;cid=testClusterID;nsid=853678551;c=1689172562208), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 14:36:05,398 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7eff7bf6e7715d2a: Processing first storage report for DS-8b24cf36-1ecd-4e29-9c51-4ca0ab6b48c8 from datanode f72d87d5-ee99-48d6-b1b3-dc081a94ff4f 2023-07-12 14:36:05,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7eff7bf6e7715d2a: from storage DS-8b24cf36-1ecd-4e29-9c51-4ca0ab6b48c8 node DatanodeRegistration(127.0.0.1:46153, datanodeUuid=f72d87d5-ee99-48d6-b1b3-dc081a94ff4f, infoPort=42045, infoSecurePort=0, ipcPort=36251, storageInfo=lv=-57;cid=testClusterID;nsid=853678551;c=1689172562208), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 14:36:05,562 DEBUG [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2 2023-07-12 14:36:05,722 INFO [Listener at localhost.localdomain/40419] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/zookeeper_0, clientPort=61257, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 14:36:05,745 INFO [Listener at localhost.localdomain/40419] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61257 2023-07-12 14:36:05,765 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:05,768 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:06,537 INFO [Listener at localhost.localdomain/40419] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 with version=8 2023-07-12 14:36:06,537 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/hbase-staging 2023-07-12 14:36:06,905 INFO [Listener at localhost.localdomain/40419] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 14:36:07,526 INFO [Listener at localhost.localdomain/40419] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 14:36:07,568 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:07,568 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:07,569 INFO [Listener at localhost.localdomain/40419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 14:36:07,569 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:07,569 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 14:36:07,749 INFO [Listener at localhost.localdomain/40419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 14:36:07,823 DEBUG [Listener at localhost.localdomain/40419] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 14:36:07,923 INFO [Listener at localhost.localdomain/40419] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35815 2023-07-12 14:36:07,937 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:07,939 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:07,977 INFO [Listener at localhost.localdomain/40419] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35815 connecting to ZooKeeper ensemble=127.0.0.1:61257 2023-07-12 14:36:08,048 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:358150x0, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 14:36:08,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35815-0x10159f559c10000 connected 2023-07-12 14:36:08,103 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 14:36:08,104 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:36:08,115 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 14:36:08,124 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35815 2023-07-12 14:36:08,126 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35815 2023-07-12 14:36:08,128 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35815 2023-07-12 14:36:08,133 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35815 2023-07-12 14:36:08,134 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35815 2023-07-12 14:36:08,142 INFO [Listener at localhost.localdomain/40419] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, hbase.cluster.distributed=false 2023-07-12 14:36:08,229 INFO [Listener at localhost.localdomain/40419] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 14:36:08,230 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,230 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,230 INFO [Listener at localhost.localdomain/40419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 14:36:08,230 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,230 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 14:36:08,237 INFO [Listener at localhost.localdomain/40419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 14:36:08,241 INFO [Listener at localhost.localdomain/40419] ipc.NettyRpcServer(120): Bind to /136.243.18.41:36691 2023-07-12 14:36:08,244 INFO [Listener at localhost.localdomain/40419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 14:36:08,252 INFO [Listener at localhost.localdomain/40419] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 14:36:08,253 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,256 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,259 INFO [Listener at localhost.localdomain/40419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36691 connecting to ZooKeeper ensemble=127.0.0.1:61257 2023-07-12 14:36:08,262 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:366910x0, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 14:36:08,265 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:366910x0, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 14:36:08,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36691-0x10159f559c10001 connected 2023-07-12 14:36:08,267 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:36:08,268 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 14:36:08,270 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36691 2023-07-12 14:36:08,271 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36691 2023-07-12 14:36:08,271 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36691 2023-07-12 14:36:08,272 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36691 2023-07-12 14:36:08,272 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36691 2023-07-12 14:36:08,286 INFO [Listener at localhost.localdomain/40419] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 14:36:08,287 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,287 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,288 INFO [Listener at localhost.localdomain/40419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 14:36:08,288 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,289 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 14:36:08,289 INFO [Listener at localhost.localdomain/40419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 14:36:08,293 INFO [Listener at localhost.localdomain/40419] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35263 2023-07-12 14:36:08,294 INFO [Listener at localhost.localdomain/40419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 14:36:08,295 INFO [Listener at localhost.localdomain/40419] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 14:36:08,295 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,298 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,302 INFO [Listener at localhost.localdomain/40419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35263 connecting to ZooKeeper ensemble=127.0.0.1:61257 2023-07-12 14:36:08,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:352630x0, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 14:36:08,311 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:352630x0, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 14:36:08,312 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:352630x0, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:36:08,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35263-0x10159f559c10002 connected 2023-07-12 14:36:08,313 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 14:36:08,315 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35263 2023-07-12 14:36:08,316 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35263 2023-07-12 14:36:08,320 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35263 2023-07-12 14:36:08,327 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35263 2023-07-12 14:36:08,327 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35263 2023-07-12 14:36:08,342 INFO [Listener at localhost.localdomain/40419] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-12 14:36:08,342 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,342 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,343 INFO [Listener at localhost.localdomain/40419] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 14:36:08,343 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 14:36:08,343 INFO [Listener at localhost.localdomain/40419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 14:36:08,343 INFO [Listener at localhost.localdomain/40419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 14:36:08,344 INFO [Listener at localhost.localdomain/40419] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35687 2023-07-12 14:36:08,345 INFO [Listener at localhost.localdomain/40419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 14:36:08,349 INFO [Listener at localhost.localdomain/40419] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 14:36:08,350 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,352 INFO [Listener at localhost.localdomain/40419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,354 INFO [Listener at localhost.localdomain/40419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35687 connecting to ZooKeeper ensemble=127.0.0.1:61257 2023-07-12 14:36:08,357 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:356870x0, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 14:36:08,358 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:356870x0, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 14:36:08,359 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:356870x0, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:36:08,359 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ZKUtil(164): regionserver:356870x0, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 14:36:08,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35687-0x10159f559c10003 connected 2023-07-12 14:36:08,365 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35687 2023-07-12 14:36:08,365 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35687 2023-07-12 14:36:08,366 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35687 2023-07-12 14:36:08,366 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35687 2023-07-12 14:36:08,368 DEBUG [Listener at localhost.localdomain/40419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35687 2023-07-12 14:36:08,372 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:08,380 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 14:36:08,382 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:08,404 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 14:36:08,404 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 14:36:08,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:08,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 14:36:08,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 14:36:08,406 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 14:36:08,408 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,35815,1689172566719 from backup master directory 2023-07-12 14:36:08,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 14:36:08,417 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:08,417 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 14:36:08,418 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 14:36:08,418 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:08,421 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 14:36:08,429 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 14:36:08,540 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/hbase.id with ID: c825d470-4030-4028-97bb-6ce2564ee808 2023-07-12 14:36:08,586 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 14:36:08,611 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:08,675 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x04e00eb1 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:08,710 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7decfe69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:08,733 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 14:36:08,735 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 14:36:08,762 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 14:36:08,762 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 14:36:08,765 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 14:36:08,770 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 14:36:08,771 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 14:36:08,815 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store-tmp 2023-07-12 14:36:08,875 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:08,875 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 14:36:08,875 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:36:08,875 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:36:08,875 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 14:36:08,875 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:36:08,875 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:36:08,875 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 14:36:08,877 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/WALs/jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:08,904 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35815%2C1689172566719, suffix=, logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/WALs/jenkins-hbase17.apache.org,35815,1689172566719, archiveDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/oldWALs, maxLogs=10 2023-07-12 14:36:08,982 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK] 2023-07-12 14:36:08,982 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK] 2023-07-12 14:36:08,983 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK] 2023-07-12 14:36:09,110 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 14:36:09,226 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/WALs/jenkins-hbase17.apache.org,35815,1689172566719/jenkins-hbase17.apache.org%2C35815%2C1689172566719.1689172568919 2023-07-12 14:36:09,228 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK], DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK], DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK]] 2023-07-12 14:36:09,229 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 14:36:09,229 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:09,235 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 14:36:09,237 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 14:36:09,327 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 14:36:09,336 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 14:36:09,366 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 14:36:09,387 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:09,394 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 14:36:09,397 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 14:36:09,423 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 14:36:09,429 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:09,430 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66669523, jitterRate=-0.006546691060066223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:09,430 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 14:36:09,431 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 14:36:09,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 14:36:09,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 14:36:09,461 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 14:36:09,464 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 14:36:09,506 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-12 14:36:09,506 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 14:36:09,549 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 14:36:09,555 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 14:36:09,584 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 14:36:09,590 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 14:36:09,592 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 14:36:09,600 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 14:36:09,607 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 14:36:09,618 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:09,623 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 14:36:09,630 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 14:36:09,651 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 14:36:09,660 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 14:36:09,660 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 14:36:09,660 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:09,660 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 14:36:09,660 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 14:36:09,667 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,35815,1689172566719, sessionid=0x10159f559c10000, setting cluster-up flag (Was=false) 2023-07-12 14:36:09,694 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:09,706 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 14:36:09,708 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:09,714 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:09,721 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 14:36:09,727 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:09,733 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp 2023-07-12 14:36:09,790 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(951): ClusterId : c825d470-4030-4028-97bb-6ce2564ee808 2023-07-12 14:36:09,791 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(951): ClusterId : c825d470-4030-4028-97bb-6ce2564ee808 2023-07-12 14:36:09,801 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 14:36:09,801 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 14:36:09,804 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(951): ClusterId : c825d470-4030-4028-97bb-6ce2564ee808 2023-07-12 14:36:09,817 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 14:36:09,820 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 14:36:09,822 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 14:36:09,830 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 14:36:09,830 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 14:36:09,831 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 14:36:09,833 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 14:36:09,833 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 14:36:09,833 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 14:36:09,838 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 14:36:09,836 DEBUG [RS:2;jenkins-hbase17:35687] zookeeper.ReadOnlyZKClient(139): Connect 0x2583e5ca to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:09,842 DEBUG [RS:1;jenkins-hbase17:35263] zookeeper.ReadOnlyZKClient(139): Connect 0x3f3d8d77 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:09,853 DEBUG [RS:0;jenkins-hbase17:36691] zookeeper.ReadOnlyZKClient(139): Connect 0x62f1e446 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:09,901 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 14:36:09,906 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:09,907 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 14:36:09,937 DEBUG [RS:1;jenkins-hbase17:35263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31fa74e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:09,942 DEBUG [RS:1;jenkins-hbase17:35263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35c5e607, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 14:36:09,945 DEBUG [RS:0;jenkins-hbase17:36691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c360668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:09,945 DEBUG [RS:0;jenkins-hbase17:36691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68098f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 14:36:09,982 DEBUG [RS:2;jenkins-hbase17:35687] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b441f0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:09,983 DEBUG [RS:2;jenkins-hbase17:35687] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a791531, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 14:36:10,009 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:35687 2023-07-12 14:36:10,015 INFO [RS:2;jenkins-hbase17:35687] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 14:36:10,015 INFO [RS:2;jenkins-hbase17:35687] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 14:36:10,016 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 14:36:10,017 INFO [RS:2;jenkins-hbase17:35687] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:10,017 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 14:36:10,021 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:36691 2023-07-12 14:36:10,024 INFO [RS:0;jenkins-hbase17:36691] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 14:36:10,029 INFO [RS:0;jenkins-hbase17:36691] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 14:36:10,029 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 14:36:10,029 INFO [RS:0;jenkins-hbase17:36691] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:10,029 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 14:36:10,033 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35815,1689172566719 with isa=jenkins-hbase17.apache.org/136.243.18.41:35687, startcode=1689172568342 2023-07-12 14:36:10,035 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35815,1689172566719 with isa=jenkins-hbase17.apache.org/136.243.18.41:36691, startcode=1689172568228 2023-07-12 14:36:10,036 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:35263 2023-07-12 14:36:10,036 INFO [RS:1;jenkins-hbase17:35263] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 14:36:10,036 INFO [RS:1;jenkins-hbase17:35263] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 14:36:10,037 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 14:36:10,037 INFO [RS:1;jenkins-hbase17:35263] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:10,037 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 14:36:10,039 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35815,1689172566719 with isa=jenkins-hbase17.apache.org/136.243.18.41:35263, startcode=1689172568285 2023-07-12 14:36:10,072 DEBUG [RS:1;jenkins-hbase17:35263] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 14:36:10,074 DEBUG [RS:0;jenkins-hbase17:36691] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 14:36:10,078 DEBUG [RS:2;jenkins-hbase17:35687] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 14:36:10,101 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 14:36:10,136 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 14:36:10,136 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 14:36:10,137 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 14:36:10,137 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-12 14:36:10,137 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-12 14:36:10,137 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,137 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 14:36:10,137 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,174 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689172600174 2023-07-12 14:36:10,176 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44869, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 14:36:10,176 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54369, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 14:36:10,178 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 14:36:10,176 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40815, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 14:36:10,180 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 14:36:10,180 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 14:36:10,187 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 14:36:10,192 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 14:36:10,221 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 14:36:10,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 14:36:10,236 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 14:36:10,244 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35815] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 14:36:10,254 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 14:36:10,255 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 14:36:10,255 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 14:36:10,255 WARN [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 14:36:10,255 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 14:36:10,257 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 14:36:10,257 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 14:36:10,257 WARN [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 14:36:10,257 WARN [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 14:36:10,257 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,259 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 14:36:10,261 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 14:36:10,262 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 14:36:10,281 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 14:36:10,282 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 14:36:10,289 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689172570288,5,FailOnTimeoutGroup] 2023-07-12 14:36:10,290 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689172570289,5,FailOnTimeoutGroup] 2023-07-12 14:36:10,290 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,295 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 14:36:10,297 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,297 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,322 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 14:36:10,324 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 14:36:10,324 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:10,358 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35815,1689172566719 with isa=jenkins-hbase17.apache.org/136.243.18.41:35687, startcode=1689172568342 2023-07-12 14:36:10,358 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35815,1689172566719 with isa=jenkins-hbase17.apache.org/136.243.18.41:35263, startcode=1689172568285 2023-07-12 14:36:10,392 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35815,1689172566719 with isa=jenkins-hbase17.apache.org/136.243.18.41:36691, startcode=1689172568228 2023-07-12 14:36:10,395 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35815] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,412 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35815] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,413 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35815] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,428 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:10,428 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36845 2023-07-12 14:36:10,428 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 14:36:10,415 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:10,429 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36845 2023-07-12 14:36:10,429 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 14:36:10,431 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:10,431 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:36845 2023-07-12 14:36:10,431 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 14:36:10,436 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 14:36:10,439 DEBUG [RS:2;jenkins-hbase17:35687] zookeeper.ZKUtil(162): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,439 DEBUG [RS:0;jenkins-hbase17:36691] zookeeper.ZKUtil(162): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,440 DEBUG [RS:1;jenkins-hbase17:35263] zookeeper.ZKUtil(162): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,439 WARN [RS:2;jenkins-hbase17:35687] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 14:36:10,440 WARN [RS:1;jenkins-hbase17:35263] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 14:36:10,440 WARN [RS:0;jenkins-hbase17:36691] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 14:36:10,450 INFO [RS:1;jenkins-hbase17:35263] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 14:36:10,455 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,450 INFO [RS:2;jenkins-hbase17:35687] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 14:36:10,457 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,450 INFO [RS:0;jenkins-hbase17:36691] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 14:36:10,457 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,463 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,35687,1689172568342] 2023-07-12 14:36:10,463 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,36691,1689172568228] 2023-07-12 14:36:10,463 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,35263,1689172568285] 2023-07-12 14:36:10,467 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:10,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 14:36:10,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/info 2023-07-12 14:36:10,483 DEBUG [RS:1;jenkins-hbase17:35263] zookeeper.ZKUtil(162): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,483 DEBUG [RS:2;jenkins-hbase17:35687] zookeeper.ZKUtil(162): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,483 DEBUG [RS:0;jenkins-hbase17:36691] zookeeper.ZKUtil(162): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,483 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 14:36:10,483 DEBUG [RS:1;jenkins-hbase17:35263] zookeeper.ZKUtil(162): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,483 DEBUG [RS:0;jenkins-hbase17:36691] zookeeper.ZKUtil(162): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,484 DEBUG [RS:2;jenkins-hbase17:35687] zookeeper.ZKUtil(162): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:10,487 DEBUG [RS:2;jenkins-hbase17:35687] zookeeper.ZKUtil(162): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 14:36:10,487 DEBUG [RS:0;jenkins-hbase17:36691] zookeeper.ZKUtil(162): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,492 DEBUG [RS:1;jenkins-hbase17:35263] zookeeper.ZKUtil(162): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,495 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 14:36:10,497 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 14:36:10,498 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:10,498 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 14:36:10,503 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 14:36:10,504 DEBUG [RS:1;jenkins-hbase17:35263] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 14:36:10,503 DEBUG [RS:2;jenkins-hbase17:35687] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 14:36:10,509 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/table 2023-07-12 14:36:10,510 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 14:36:10,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:10,514 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740 2023-07-12 14:36:10,523 INFO [RS:1;jenkins-hbase17:35263] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 14:36:10,533 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740 2023-07-12 14:36:10,534 INFO [RS:0;jenkins-hbase17:36691] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 14:36:10,554 INFO [RS:2;jenkins-hbase17:35687] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 14:36:10,558 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 14:36:10,562 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 14:36:10,569 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:10,571 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69102349, jitterRate=0.029705241322517395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 14:36:10,571 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 14:36:10,571 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 14:36:10,571 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 14:36:10,571 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 14:36:10,571 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 14:36:10,571 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 14:36:10,572 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 14:36:10,581 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 14:36:10,588 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 14:36:10,588 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 14:36:10,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 14:36:10,613 INFO [RS:2;jenkins-hbase17:35687] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 14:36:10,614 INFO [RS:0;jenkins-hbase17:36691] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 14:36:10,616 INFO [RS:1;jenkins-hbase17:35263] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 14:36:10,626 INFO [RS:1;jenkins-hbase17:35263] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 14:36:10,626 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,626 INFO [RS:2;jenkins-hbase17:35687] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 14:36:10,631 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 14:36:10,631 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,629 INFO [RS:0;jenkins-hbase17:36691] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 14:36:10,631 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,631 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 14:36:10,632 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 14:36:10,637 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 14:36:10,645 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 14:36:10,646 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,646 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,647 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,647 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,647 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,647 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,647 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 14:36:10,647 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,647 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,648 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,648 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,649 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,649 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,649 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,649 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 14:36:10,649 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,647 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,649 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,649 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,650 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,650 DEBUG [RS:1;jenkins-hbase17:35263] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,650 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,650 DEBUG [RS:0;jenkins-hbase17:36691] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,648 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,660 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,660 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,660 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,661 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,661 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,663 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,661 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,670 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-12 14:36:10,671 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,671 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,672 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,672 DEBUG [RS:2;jenkins-hbase17:35687] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-12 14:36:10,693 INFO [RS:1;jenkins-hbase17:35263] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 14:36:10,697 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35263,1689172568285-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,709 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,710 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,710 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,712 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,713 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,713 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,735 INFO [RS:0;jenkins-hbase17:36691] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 14:36:10,752 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36691,1689172568228-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,769 INFO [RS:2;jenkins-hbase17:35687] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 14:36:10,770 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35687,1689172568342-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:10,775 INFO [RS:1;jenkins-hbase17:35263] regionserver.Replication(203): jenkins-hbase17.apache.org,35263,1689172568285 started 2023-07-12 14:36:10,775 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,35263,1689172568285, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:35263, sessionid=0x10159f559c10002 2023-07-12 14:36:10,775 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 14:36:10,775 DEBUG [RS:1;jenkins-hbase17:35263] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,776 DEBUG [RS:1;jenkins-hbase17:35263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35263,1689172568285' 2023-07-12 14:36:10,776 DEBUG [RS:1;jenkins-hbase17:35263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 14:36:10,776 DEBUG [RS:1;jenkins-hbase17:35263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 14:36:10,777 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 14:36:10,777 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 14:36:10,777 DEBUG [RS:1;jenkins-hbase17:35263] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:10,777 DEBUG [RS:1;jenkins-hbase17:35263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35263,1689172568285' 2023-07-12 14:36:10,777 DEBUG [RS:1;jenkins-hbase17:35263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:10,778 DEBUG [RS:1;jenkins-hbase17:35263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:10,779 DEBUG [RS:1;jenkins-hbase17:35263] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 14:36:10,779 INFO [RS:1;jenkins-hbase17:35263] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 14:36:10,779 INFO [RS:1;jenkins-hbase17:35263] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 14:36:10,783 INFO [RS:0;jenkins-hbase17:36691] regionserver.Replication(203): jenkins-hbase17.apache.org,36691,1689172568228 started 2023-07-12 14:36:10,783 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,36691,1689172568228, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:36691, sessionid=0x10159f559c10001 2023-07-12 14:36:10,783 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 14:36:10,783 DEBUG [RS:0;jenkins-hbase17:36691] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,784 DEBUG [RS:0;jenkins-hbase17:36691] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36691,1689172568228' 2023-07-12 14:36:10,784 DEBUG [RS:0;jenkins-hbase17:36691] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 14:36:10,784 DEBUG [RS:0;jenkins-hbase17:36691] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 14:36:10,785 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 14:36:10,785 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 14:36:10,785 DEBUG [RS:0;jenkins-hbase17:36691] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:10,785 DEBUG [RS:0;jenkins-hbase17:36691] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36691,1689172568228' 2023-07-12 14:36:10,786 DEBUG [RS:0;jenkins-hbase17:36691] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:10,786 DEBUG [RS:0;jenkins-hbase17:36691] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:10,786 DEBUG [RS:0;jenkins-hbase17:36691] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 14:36:10,787 INFO [RS:0;jenkins-hbase17:36691] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 14:36:10,787 INFO [RS:0;jenkins-hbase17:36691] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 14:36:10,790 INFO [RS:2;jenkins-hbase17:35687] regionserver.Replication(203): jenkins-hbase17.apache.org,35687,1689172568342 started 2023-07-12 14:36:10,791 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,35687,1689172568342, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:35687, sessionid=0x10159f559c10003 2023-07-12 14:36:10,791 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 14:36:10,791 DEBUG [RS:2;jenkins-hbase17:35687] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,791 DEBUG [RS:2;jenkins-hbase17:35687] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35687,1689172568342' 2023-07-12 14:36:10,791 DEBUG [RS:2;jenkins-hbase17:35687] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 14:36:10,792 DEBUG [RS:2;jenkins-hbase17:35687] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 14:36:10,792 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 14:36:10,792 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 14:36:10,792 DEBUG [RS:2;jenkins-hbase17:35687] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:10,792 DEBUG [RS:2;jenkins-hbase17:35687] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35687,1689172568342' 2023-07-12 14:36:10,792 DEBUG [RS:2;jenkins-hbase17:35687] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:10,793 DEBUG [RS:2;jenkins-hbase17:35687] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:10,793 DEBUG [RS:2;jenkins-hbase17:35687] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 14:36:10,794 INFO [RS:2;jenkins-hbase17:35687] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 14:36:10,794 INFO [RS:2;jenkins-hbase17:35687] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 14:36:10,797 DEBUG [jenkins-hbase17:35815] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 14:36:10,801 DEBUG [jenkins-hbase17:35815] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:36:10,806 DEBUG [jenkins-hbase17:35815] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:36:10,806 DEBUG [jenkins-hbase17:35815] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:36:10,806 DEBUG [jenkins-hbase17:35815] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:36:10,806 DEBUG [jenkins-hbase17:35815] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:36:10,809 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,36691,1689172568228, state=OPENING 2023-07-12 14:36:10,815 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 14:36:10,816 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:10,817 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 14:36:10,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:36:10,892 INFO [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36691%2C1689172568228, suffix=, logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,36691,1689172568228, archiveDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs, maxLogs=32 2023-07-12 14:36:10,896 INFO [RS:1;jenkins-hbase17:35263] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35263%2C1689172568285, suffix=, logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,35263,1689172568285, archiveDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs, maxLogs=32 2023-07-12 14:36:10,911 INFO [RS:2;jenkins-hbase17:35687] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35687%2C1689172568342, suffix=, logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,35687,1689172568342, archiveDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs, maxLogs=32 2023-07-12 14:36:10,967 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK] 2023-07-12 14:36:10,969 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK] 2023-07-12 14:36:10,979 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK] 2023-07-12 14:36:10,984 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK] 2023-07-12 14:36:10,987 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK] 2023-07-12 14:36:11,049 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK] 2023-07-12 14:36:11,051 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK] 2023-07-12 14:36:11,052 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK] 2023-07-12 14:36:11,053 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK] 2023-07-12 14:36:11,082 INFO [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,36691,1689172568228/jenkins-hbase17.apache.org%2C36691%2C1689172568228.1689172570895 2023-07-12 14:36:11,088 INFO [RS:1;jenkins-hbase17:35263] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,35263,1689172568285/jenkins-hbase17.apache.org%2C35263%2C1689172568285.1689172570903 2023-07-12 14:36:11,090 DEBUG [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK], DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK], DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK]] 2023-07-12 14:36:11,102 DEBUG [RS:1;jenkins-hbase17:35263] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK], DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK], DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK]] 2023-07-12 14:36:11,102 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:11,106 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 14:36:11,125 INFO [RS:2;jenkins-hbase17:35687] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,35687,1689172568342/jenkins-hbase17.apache.org%2C35687%2C1689172568342.1689172570913 2023-07-12 14:36:11,126 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 14:36:11,136 DEBUG [RS:2;jenkins-hbase17:35687] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK], DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK], DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK]] 2023-07-12 14:36:11,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 14:36:11,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 14:36:11,156 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36691%2C1689172568228.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,36691,1689172568228, archiveDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs, maxLogs=32 2023-07-12 14:36:11,176 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK] 2023-07-12 14:36:11,179 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK] 2023-07-12 14:36:11,179 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK] 2023-07-12 14:36:11,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/WALs/jenkins-hbase17.apache.org,36691,1689172568228/jenkins-hbase17.apache.org%2C36691%2C1689172568228.meta.1689172571158.meta 2023-07-12 14:36:11,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK], DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK], DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK]] 2023-07-12 14:36:11,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 14:36:11,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 14:36:11,195 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:11,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 14:36:11,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 14:36:11,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 14:36:11,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 14:36:11,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:11,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 14:36:11,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 14:36:11,216 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 14:36:11,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/info 2023-07-12 14:36:11,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/info 2023-07-12 14:36:11,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 14:36:11,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:11,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 14:36:11,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 14:36:11,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/rep_barrier 2023-07-12 14:36:11,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 14:36:11,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:11,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 14:36:11,229 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/table 2023-07-12 14:36:11,229 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/table 2023-07-12 14:36:11,230 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 14:36:11,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:11,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740 2023-07-12 14:36:11,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740 2023-07-12 14:36:11,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 14:36:11,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 14:36:11,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58846730, jitterRate=-0.12311539053916931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 14:36:11,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 14:36:11,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689172571092 2023-07-12 14:36:11,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 14:36:11,297 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,36691,1689172568228, state=OPEN 2023-07-12 14:36:11,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 14:36:11,300 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 14:36:11,301 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 14:36:11,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 14:36:11,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,36691,1689172568228 in 446 msec 2023-07-12 14:36:11,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 14:36:11,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 706 msec 2023-07-12 14:36:11,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3660 sec 2023-07-12 14:36:11,320 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689172571320, completionTime=-1 2023-07-12 14:36:11,320 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 14:36:11,320 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 14:36:11,413 DEBUG [hconnection-0x6dc26636-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:11,420 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:11,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 14:36:11,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689172631457 2023-07-12 14:36:11,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689172691457 2023-07-12 14:36:11,457 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 137 msec 2023-07-12 14:36:11,485 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35815,1689172566719-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:11,485 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35815,1689172566719-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:11,485 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35815,1689172566719-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:11,487 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:35815, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:11,487 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 14:36:11,496 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 14:36:11,505 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 14:36:11,506 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 14:36:11,518 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 14:36:11,522 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:36:11,528 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:36:11,556 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:11,561 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453 empty. 2023-07-12 14:36:11,561 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:11,561 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 14:36:11,673 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 14:36:11,676 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6dffbe3a8c5917c633c069e9f059453, NAME => 'hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:36:11,735 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:11,735 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e6dffbe3a8c5917c633c069e9f059453, disabling compactions & flushes 2023-07-12 14:36:11,735 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:11,736 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:11,736 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. after waiting 0 ms 2023-07-12 14:36:11,736 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:11,736 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:11,736 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e6dffbe3a8c5917c633c069e9f059453: 2023-07-12 14:36:11,741 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:36:11,763 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689172571749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172571749"}]},"ts":"1689172571749"} 2023-07-12 14:36:11,812 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 14:36:11,815 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:36:11,820 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172571815"}]},"ts":"1689172571815"} 2023-07-12 14:36:11,826 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 14:36:11,830 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:36:11,831 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:36:11,831 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:36:11,831 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:36:11,831 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:36:11,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e6dffbe3a8c5917c633c069e9f059453, ASSIGN}] 2023-07-12 14:36:11,841 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e6dffbe3a8c5917c633c069e9f059453, ASSIGN 2023-07-12 14:36:11,843 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e6dffbe3a8c5917c633c069e9f059453, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:36:11,996 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 14:36:11,997 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e6dffbe3a8c5917c633c069e9f059453, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:11,998 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689172571997"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172571997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172571997"}]},"ts":"1689172571997"} 2023-07-12 14:36:12,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e6dffbe3a8c5917c633c069e9f059453, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:36:12,167 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:12,167 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6dffbe3a8c5917c633c069e9f059453, NAME => 'hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.', STARTKEY => '', ENDKEY => ''} 2023-07-12 14:36:12,168 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. service=AccessControlService 2023-07-12 14:36:12,169 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:12,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:12,170 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,170 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,172 INFO [StoreOpener-e6dffbe3a8c5917c633c069e9f059453-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,175 DEBUG [StoreOpener-e6dffbe3a8c5917c633c069e9f059453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/info 2023-07-12 14:36:12,175 DEBUG [StoreOpener-e6dffbe3a8c5917c633c069e9f059453-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/info 2023-07-12 14:36:12,176 INFO [StoreOpener-e6dffbe3a8c5917c633c069e9f059453-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6dffbe3a8c5917c633c069e9f059453 columnFamilyName info 2023-07-12 14:36:12,177 INFO [StoreOpener-e6dffbe3a8c5917c633c069e9f059453-1] regionserver.HStore(310): Store=e6dffbe3a8c5917c633c069e9f059453/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:12,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:36:12,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:12,190 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e6dffbe3a8c5917c633c069e9f059453; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64751560, jitterRate=-0.035126566886901855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:12,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e6dffbe3a8c5917c633c069e9f059453: 2023-07-12 14:36:12,192 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453., pid=6, masterSystemTime=1689172572161 2023-07-12 14:36:12,196 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:12,197 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:36:12,198 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e6dffbe3a8c5917c633c069e9f059453, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:12,199 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689172572198"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172572198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172572198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172572198"}]},"ts":"1689172572198"} 2023-07-12 14:36:12,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 14:36:12,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e6dffbe3a8c5917c633c069e9f059453, server=jenkins-hbase17.apache.org,36691,1689172568228 in 198 msec 2023-07-12 14:36:12,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 14:36:12,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e6dffbe3a8c5917c633c069e9f059453, ASSIGN in 371 msec 2023-07-12 14:36:12,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:36:12,215 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172572215"}]},"ts":"1689172572215"} 2023-07-12 14:36:12,218 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 14:36:12,222 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 14:36:12,222 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:36:12,223 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 14:36:12,223 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:12,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 715 msec 2023-07-12 14:36:12,258 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 14:36:12,275 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 14:36:12,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-07-12 14:36:12,296 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 14:36:12,326 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 14:36:12,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 36 msec 2023-07-12 14:36:12,342 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 14:36:12,343 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 14:36:12,343 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.925sec 2023-07-12 14:36:12,347 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 14:36:12,349 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 14:36:12,349 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 14:36:12,351 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35815,1689172566719-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 14:36:12,352 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35815,1689172566719-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 14:36:12,387 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 14:36:12,392 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 14:36:12,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:36:12,403 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:36:12,406 DEBUG [Listener at localhost.localdomain/40419] zookeeper.ReadOnlyZKClient(139): Connect 0x13743ba0 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:12,409 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 14:36:12,414 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/acl/0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:12,416 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/acl/0ebccd86b5445c4071777db1be472c93 empty. 2023-07-12 14:36:12,421 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 14:36:12,424 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/acl/0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:12,424 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 14:36:12,479 DEBUG [Listener at localhost.localdomain/40419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c38bf29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:12,529 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 14:36:12,552 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 14:36:12,555 DEBUG [hconnection-0x2a2dca43-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:12,561 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ebccd86b5445c4071777db1be472c93, NAME => 'hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:36:12,601 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:12,613 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:36:12,626 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 14:36:12,626 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/test.cache.data in system properties and HBase conf 2023-07-12 14:36:12,626 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 14:36:12,626 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop.log.dir in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 14:36:12,627 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/nfs.dump.dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 14:36:12,628 INFO [Listener at localhost.localdomain/40419] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 14:36:12,692 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:12,692 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0ebccd86b5445c4071777db1be472c93, disabling compactions & flushes 2023-07-12 14:36:12,692 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:12,692 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:12,692 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. after waiting 0 ms 2023-07-12 14:36:12,692 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:12,692 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:12,692 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0ebccd86b5445c4071777db1be472c93: 2023-07-12 14:36:12,697 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:36:12,699 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689172572699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172572699"}]},"ts":"1689172572699"} 2023-07-12 14:36:12,703 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 14:36:12,705 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:36:12,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172572705"}]},"ts":"1689172572705"} 2023-07-12 14:36:12,709 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 14:36:12,713 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:36:12,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:36:12,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:36:12,715 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:36:12,715 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:36:12,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0ebccd86b5445c4071777db1be472c93, ASSIGN}] 2023-07-12 14:36:12,719 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0ebccd86b5445c4071777db1be472c93, ASSIGN 2023-07-12 14:36:12,721 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0ebccd86b5445c4071777db1be472c93, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:36:12,729 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 14:36:12,872 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 14:36:12,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0ebccd86b5445c4071777db1be472c93, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:12,882 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689172572882"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172572882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172572882"}]},"ts":"1689172572882"} 2023-07-12 14:36:12,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0ebccd86b5445c4071777db1be472c93, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:36:13,030 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 14:36:13,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:13,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ebccd86b5445c4071777db1be472c93, NAME => 'hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.', STARTKEY => '', ENDKEY => ''} 2023-07-12 14:36:13,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. service=AccessControlService 2023-07-12 14:36:13,115 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:13,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:13,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,117 INFO [StoreOpener-0ebccd86b5445c4071777db1be472c93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,122 DEBUG [StoreOpener-0ebccd86b5445c4071777db1be472c93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/l 2023-07-12 14:36:13,122 DEBUG [StoreOpener-0ebccd86b5445c4071777db1be472c93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/l 2023-07-12 14:36:13,123 INFO [StoreOpener-0ebccd86b5445c4071777db1be472c93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ebccd86b5445c4071777db1be472c93 columnFamilyName l 2023-07-12 14:36:13,124 INFO [StoreOpener-0ebccd86b5445c4071777db1be472c93-1] regionserver.HStore(310): Store=0ebccd86b5445c4071777db1be472c93/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:13,126 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0ebccd86b5445c4071777db1be472c93 2023-07-12 14:36:13,139 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:13,140 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0ebccd86b5445c4071777db1be472c93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66042254, jitterRate=-0.01589372754096985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:13,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0ebccd86b5445c4071777db1be472c93: 2023-07-12 14:36:13,142 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93., pid=11, masterSystemTime=1689172573100 2023-07-12 14:36:13,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:13,146 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:36:13,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0ebccd86b5445c4071777db1be472c93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:13,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689172573156"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172573156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172573156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172573156"}]},"ts":"1689172573156"} 2023-07-12 14:36:13,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 14:36:13,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0ebccd86b5445c4071777db1be472c93, server=jenkins-hbase17.apache.org,36691,1689172568228 in 251 msec 2023-07-12 14:36:13,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 14:36:13,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0ebccd86b5445c4071777db1be472c93, ASSIGN in 453 msec 2023-07-12 14:36:13,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:36:13,183 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172573183"}]},"ts":"1689172573183"} 2023-07-12 14:36:13,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 14:36:13,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:36:13,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 805 msec 2023-07-12 14:36:13,530 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 14:36:13,530 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 14:36:13,553 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 14:36:15,172 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:15,657 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:15,668 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_38199_jobhistory____ez4mld/webapp 2023-07-12 14:36:15,910 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 14:36:15,910 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 14:36:15,911 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 14:36:15,914 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 14:36:16,036 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:16,579 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:16,790 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:36:16,983 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 14:36:16,985 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 14:36:16,986 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 14:36:16,988 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:36:16,989 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 14:36:16,989 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:36:16,989 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 14:36:16,990 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 14:36:16,990 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 14:36:16,990 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:36:16,990 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 14:36:16,990 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 14:36:16,993 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 14:36:17,466 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 14:36:17,580 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:38199 2023-07-12 14:36:18,151 WARN [Listener at jenkins-hbase17.apache.org/36075] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:18,264 WARN [Listener at jenkins-hbase17.apache.org/36075] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 14:36:18,264 INFO [Listener at jenkins-hbase17.apache.org/36075] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:18,275 INFO [Listener at jenkins-hbase17.apache.org/36075] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40365_cluster____7eh9qa/webapp 2023-07-12 14:36:18,347 INFO [Listener at jenkins-hbase17.apache.org/36075] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 14:36:18,348 INFO [Listener at jenkins-hbase17.apache.org/36075] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 14:36:18,348 INFO [Listener at jenkins-hbase17.apache.org/36075] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 14:36:18,349 INFO [Listener at jenkins-hbase17.apache.org/36075] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 14:36:18,360 INFO [Listener at jenkins-hbase17.apache.org/36075] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:18,631 INFO [Listener at jenkins-hbase17.apache.org/36075] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:18,820 INFO [Listener at jenkins-hbase17.apache.org/36075] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:18,848 INFO [Listener at jenkins-hbase17.apache.org/36075] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40365 2023-07-12 14:36:19,563 WARN [Listener at jenkins-hbase17.apache.org/41177] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:19,597 WARN [Listener at jenkins-hbase17.apache.org/41177] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 14:36:19,598 INFO [Listener at jenkins-hbase17.apache.org/41177] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:19,609 INFO [Listener at jenkins-hbase17.apache.org/41177] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_39763_node____.pqeknc/webapp 2023-07-12 14:36:19,663 INFO [Listener at jenkins-hbase17.apache.org/41177] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 14:36:19,664 INFO [Listener at jenkins-hbase17.apache.org/41177] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 14:36:19,664 INFO [Listener at jenkins-hbase17.apache.org/41177] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 14:36:19,664 INFO [Listener at jenkins-hbase17.apache.org/41177] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 14:36:19,672 INFO [Listener at jenkins-hbase17.apache.org/41177] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:19,695 INFO [Listener at jenkins-hbase17.apache.org/41177] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:19,817 INFO [Listener at jenkins-hbase17.apache.org/41177] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:19,861 INFO [Listener at jenkins-hbase17.apache.org/41177] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39763 2023-07-12 14:36:20,248 WARN [Listener at jenkins-hbase17.apache.org/34087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 14:36:20,256 WARN [Listener at jenkins-hbase17.apache.org/34087] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 14:36:20,257 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 14:36:20,266 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_34035_node____.kh3ybp/webapp 2023-07-12 14:36:20,333 INFO [Listener at jenkins-hbase17.apache.org/34087] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 14:36:20,333 INFO [Listener at jenkins-hbase17.apache.org/34087] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 14:36:20,334 INFO [Listener at jenkins-hbase17.apache.org/34087] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 14:36:20,334 INFO [Listener at jenkins-hbase17.apache.org/34087] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 14:36:20,346 INFO [Listener at jenkins-hbase17.apache.org/34087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:20,364 INFO [Listener at jenkins-hbase17.apache.org/34087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:20,460 INFO [Listener at jenkins-hbase17.apache.org/34087] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 14:36:20,480 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:34035 2023-07-12 14:36:20,513 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 14:36:20,515 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:36:20,603 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=527, ProcessCount=178, AvailableMemoryMB=3451 2023-07-12 14:36:20,603 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-12 14:36:20,622 DEBUG [Listener at jenkins-hbase17.apache.org/34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 14:36:20,637 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 14:36:20,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 14:36:20,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:20,653 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:36:20,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 14:36:20,657 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:36:20,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 14:36:20,663 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:20,668 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:20,668 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 empty. 2023-07-12 14:36:20,670 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:20,670 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d empty. 2023-07-12 14:36:20,673 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:20,673 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 14:36:20,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 14:36:20,790 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 14:36:20,795 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e61b338ede929a449180ebe6753bb053, NAME => 'testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:36:20,797 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1fc7af4b18a0d9d974f056ae53bccf7d, NAME => 'testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:36:20,910 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:20,912 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e61b338ede929a449180ebe6753bb053, disabling compactions & flushes 2023-07-12 14:36:20,912 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:20,912 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:20,912 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. after waiting 0 ms 2023-07-12 14:36:20,912 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:20,913 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:20,913 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e61b338ede929a449180ebe6753bb053: 2023-07-12 14:36:20,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 14:36:21,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 14:36:21,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:21,314 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1fc7af4b18a0d9d974f056ae53bccf7d, disabling compactions & flushes 2023-07-12 14:36:21,314 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,314 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,314 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. after waiting 0 ms 2023-07-12 14:36:21,314 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,314 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,314 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1fc7af4b18a0d9d974f056ae53bccf7d: 2023-07-12 14:36:21,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:36:21,323 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172581322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172581322"}]},"ts":"1689172581322"} 2023-07-12 14:36:21,323 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172581322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172581322"}]},"ts":"1689172581322"} 2023-07-12 14:36:21,393 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:36:21,397 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:36:21,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172581397"}]},"ts":"1689172581397"} 2023-07-12 14:36:21,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 14:36:21,412 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:36:21,416 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:36:21,416 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:36:21,416 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:36:21,416 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:36:21,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, ASSIGN}] 2023-07-12 14:36:21,429 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, ASSIGN 2023-07-12 14:36:21,429 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, ASSIGN 2023-07-12 14:36:21,430 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35687,1689172568342; forceNewPlan=false, retain=false 2023-07-12 14:36:21,430 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:36:21,581 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:36:21,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1fc7af4b18a0d9d974f056ae53bccf7d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:21,583 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e61b338ede929a449180ebe6753bb053, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:21,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172581583"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172581583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172581583"}]},"ts":"1689172581583"} 2023-07-12 14:36:21,584 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172581583"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172581583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172581583"}]},"ts":"1689172581583"} 2023-07-12 14:36:21,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 1fc7af4b18a0d9d974f056ae53bccf7d, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:36:21,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e61b338ede929a449180ebe6753bb053, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:36:21,745 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:21,745 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 14:36:21,749 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 14:36:21,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1fc7af4b18a0d9d974f056ae53bccf7d, NAME => 'testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 14:36:21,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. service=AccessControlService 2023-07-12 14:36:21,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:21,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:21,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:21,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e61b338ede929a449180ebe6753bb053, NAME => 'testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 14:36:21,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. service=AccessControlService 2023-07-12 14:36:21,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:21,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:21,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,766 INFO [StoreOpener-1fc7af4b18a0d9d974f056ae53bccf7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,769 DEBUG [StoreOpener-1fc7af4b18a0d9d974f056ae53bccf7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf 2023-07-12 14:36:21,770 DEBUG [StoreOpener-1fc7af4b18a0d9d974f056ae53bccf7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf 2023-07-12 14:36:21,774 INFO [StoreOpener-1fc7af4b18a0d9d974f056ae53bccf7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fc7af4b18a0d9d974f056ae53bccf7d columnFamilyName cf 2023-07-12 14:36:21,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 14:36:21,777 INFO [StoreOpener-e61b338ede929a449180ebe6753bb053-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,781 INFO [StoreOpener-1fc7af4b18a0d9d974f056ae53bccf7d-1] regionserver.HStore(310): Store=1fc7af4b18a0d9d974f056ae53bccf7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:21,782 DEBUG [StoreOpener-e61b338ede929a449180ebe6753bb053-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf 2023-07-12 14:36:21,782 DEBUG [StoreOpener-e61b338ede929a449180ebe6753bb053-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf 2023-07-12 14:36:21,783 INFO [StoreOpener-e61b338ede929a449180ebe6753bb053-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e61b338ede929a449180ebe6753bb053 columnFamilyName cf 2023-07-12 14:36:21,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,785 INFO [StoreOpener-e61b338ede929a449180ebe6753bb053-1] regionserver.HStore(310): Store=e61b338ede929a449180ebe6753bb053/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:21,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:21,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:21,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:21,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:21,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1fc7af4b18a0d9d974f056ae53bccf7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63238205, jitterRate=-0.057677313685417175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:21,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1fc7af4b18a0d9d974f056ae53bccf7d: 2023-07-12 14:36:21,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e61b338ede929a449180ebe6753bb053; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67592354, jitterRate=0.007204562425613403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:21,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e61b338ede929a449180ebe6753bb053: 2023-07-12 14:36:21,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d., pid=15, masterSystemTime=1689172581742 2023-07-12 14:36:21,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053., pid=16, masterSystemTime=1689172581745 2023-07-12 14:36:21,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:21,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1fc7af4b18a0d9d974f056ae53bccf7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:21,838 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172581837"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172581837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172581837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172581837"}]},"ts":"1689172581837"} 2023-07-12 14:36:21,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:21,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e61b338ede929a449180ebe6753bb053, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:21,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172581841"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172581841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172581841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172581841"}]},"ts":"1689172581841"} 2023-07-12 14:36:21,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:21,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 14:36:21,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 1fc7af4b18a0d9d974f056ae53bccf7d, server=jenkins-hbase17.apache.org,36691,1689172568228 in 256 msec 2023-07-12 14:36:21,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 14:36:21,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, ASSIGN in 436 msec 2023-07-12 14:36:21,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e61b338ede929a449180ebe6753bb053, server=jenkins-hbase17.apache.org,35687,1689172568342 in 257 msec 2023-07-12 14:36:21,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 14:36:21,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, ASSIGN in 439 msec 2023-07-12 14:36:21,861 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:36:21,861 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172581861"}]},"ts":"1689172581861"} 2023-07-12 14:36:21,863 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 14:36:21,866 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:36:21,872 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 14:36:21,892 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 14:36:21,923 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:21,923 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:21,923 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:21,923 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:21,924 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:36:21,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:21,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:21,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:21,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:21,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.2850 sec 2023-07-12 14:36:22,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 14:36:22,777 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 14:36:22,784 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 14:36:22,785 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:22,788 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:36:22,816 DEBUG [hconnection-0x2a2dca43-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:22,822 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:22,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 14:36:22,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172582842 (current time:1689172582842). 2023-07-12 14:36:22,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:36:22,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x579fc7b8 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:22,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24046f19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:22,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:22,855 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:22,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x579fc7b8 to 127.0.0.1:61257 2023-07-12 14:36:22,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:22,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x0f1eae2a to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2847477a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:22,963 DEBUG [hconnection-0x7f5681ed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:22,968 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:22,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f1eae2a to 127.0.0.1:61257 2023-07-12 14:36:22,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:22,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 14:36:22,987 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 14:36:23,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:36:23,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 14:36:23,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 14:36:23,030 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 14:36:23,032 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689173183032 2023-07-12 14:36:23,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 14:36:23,032 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 14:36:23,037 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 14:36:23,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 14:36:23,041 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:36:23,041 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:36:23,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-12 14:36:23,043 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 14:36:23,044 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689173183044 2023-07-12 14:36:23,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,107 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 14:36:23,107 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,108 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 14:36:23,108 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 14:36:23,109 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,109 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,112 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,112 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,112 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,112 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 14:36:23,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,115 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 14:36:23,117 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,117 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 14:36:23,118 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,118 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:36:23,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,119 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 14:36:23,119 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,121 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 14:36:23,121 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 14:36:23,121 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 14:36:23,121 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 14:36:23,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 14:36:23,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 14:36:23,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,122 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 14:36:23,122 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,123 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 14:36:23,123 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,124 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 14:36:23,125 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 14:36:23,125 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 14:36:23,125 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,124 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 14:36:23,125 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 14:36:23,125 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 14:36:23,126 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,127 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:23,127 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,127 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,129 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,129 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,129 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:23,132 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,132 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,133 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 14:36:23,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@444335db[Count = 1] remaining members to acquire global barrier 2023-07-12 14:36:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,141 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:23,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:23,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 14:36:23,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@444335db[Count = 0] remaining members to acquire global barrier 2023-07-12 14:36:23,146 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 14:36:23,146 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:23,150 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:36:23,150 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,150 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 14:36:23,150 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 14:36:23,150 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:36:23,151 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,153 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,153 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,153 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 14:36:23,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,153 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,153 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:36:23,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,153 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:23,154 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 14:36:23,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,154 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 14:36:23,155 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 14:36:23,164 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:23,164 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:23,164 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:23,164 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. started... 2023-07-12 14:36:23,178 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:23,178 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:23,178 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:23,178 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. started... 2023-07-12 14:36:23,180 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1fc7af4b18a0d9d974f056ae53bccf7d: 2023-07-12 14:36:23,180 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e61b338ede929a449180ebe6753bb053: 2023-07-12 14:36:23,182 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,182 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,190 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:23,190 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:23,196 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:36:23,196 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:36:23,258 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. completed. 2023-07-12 14:36:23,258 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. completed. 2023-07-12 14:36:23,258 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:23,258 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:36:23,259 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:36:23,262 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 14:36:23,262 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,262 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,262 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 14:36:23,262 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 14:36:23,263 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,262 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,263 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 14:36:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:36:23,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 14:36:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:36:23,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 14:36:23,278 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 14:36:23,278 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:36:23,278 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:36:23,278 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,278 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:23,281 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:23,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:23,283 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,284 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,284 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,286 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,287 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,287 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,309 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,309 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:23,309 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,309 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:23,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:23,310 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:23,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 14:36:23,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:36:23,310 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,312 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,312 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:23,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:23,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 14:36:23,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:23,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,350 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:23,352 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 14:36:23,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 14:36:23,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,516 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:23,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689172583032Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689172583343 (+311 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689172583343Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689172583344 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689172583377 (+33 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689172583428 (+51 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689172583516 (+88 ms) 2023-07-12 14:36:23,520 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 14:36:23,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 485 msec 2023-07-12 14:36:23,652 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:23,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:23,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:36:23,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35687] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:36:23,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36691] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:36:23,688 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 14:36:23,688 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:23,688 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:36:23,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 14:36:23,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172583715 (current time:1689172583715). 2023-07-12 14:36:23,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:36:23,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x5a56f521 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:23,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@197beead, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:23,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:23,727 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:23,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a56f521 to 127.0.0.1:61257 2023-07-12 14:36:23,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:23,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x626fec1b to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:23,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ffde28a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:23,744 DEBUG [hconnection-0x49356b5e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:23,748 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:23,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x626fec1b to 127.0.0.1:61257 2023-07-12 14:36:23,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:23,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 14:36:23,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:36:23,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 14:36:23,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 14:36:23,770 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 14:36:23,772 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689173183772 2023-07-12 14:36:23,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 14:36:23,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 14:36:23,775 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:36:23,775 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:36:23,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 14:36:23,778 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 14:36:23,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-12 14:36:23,786 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 14:36:23,796 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689173183796 2023-07-12 14:36:23,875 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:23,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:23,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:23,878 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:36:23,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 14:36:23,917 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 14:36:23,917 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,917 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 14:36:23,917 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 14:36:23,918 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,918 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,919 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,919 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,919 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:23,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,919 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:23,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:23,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,921 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,921 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 14:36:23,921 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,921 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:36:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 14:36:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 14:36:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 14:36:23,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 14:36:23,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 14:36:23,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 14:36:23,924 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 14:36:23,924 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 14:36:23,932 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 14:36:23,937 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,937 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 14:36:23,938 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 14:36:23,938 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 14:36:23,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 14:36:23,944 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 14:36:23,944 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:23,946 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 14:36:23,946 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 14:36:23,947 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 14:36:23,946 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 14:36:23,947 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 14:36:23,947 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 14:36:23,952 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,952 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,952 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,953 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,953 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,953 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,953 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,953 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,954 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 14:36:23,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5062dd6a[Count = 1] remaining members to acquire global barrier 2023-07-12 14:36:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:23,958 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,958 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:23,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:23,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:23,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 14:36:23,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5062dd6a[Count = 0] remaining members to acquire global barrier 2023-07-12 14:36:23,960 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 14:36:23,960 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 14:36:23,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:23,962 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 14:36:23,962 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 14:36:23,962 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 14:36:23,962 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:36:23,963 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:23,963 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:36:23,976 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:23,976 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:23,976 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:23,978 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. started... 2023-07-12 14:36:23,978 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 14:36:23,978 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:23,978 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 14:36:23,978 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e61b338ede929a449180ebe6753bb053 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 14:36:23,980 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:23,980 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:23,980 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:23,988 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. started... 2023-07-12 14:36:23,989 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1fc7af4b18a0d9d974f056ae53bccf7d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 14:36:24,078 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:24,082 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 14:36:24,300 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071274d6116aabf34f07b6eedf85e95ddc7e to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071274d6116aabf34f07b6eedf85e95ddc7e 2023-07-12 14:36:24,300 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712b11b76feba0c4be887930d9b6e975215 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712b11b76feba0c4be887930d9b6e975215 2023-07-12 14:36:24,383 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:24,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:24,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:24,400 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 14:36:24,411 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/.tmp/cf/c4f49c9c2721458da88de01d860ee54c 2023-07-12 14:36:24,411 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/.tmp/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58 2023-07-12 14:36:24,424 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/.tmp/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58 2023-07-12 14:36:24,425 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/.tmp/cf/c4f49c9c2721458da88de01d860ee54c as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf/c4f49c9c2721458da88de01d860ee54c 2023-07-12 14:36:24,442 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf/c4f49c9c2721458da88de01d860ee54c, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 14:36:24,444 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e61b338ede929a449180ebe6753bb053 in 466ms, sequenceid=6, compaction requested=false 2023-07-12 14:36:24,445 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e61b338ede929a449180ebe6753bb053: 2023-07-12 14:36:24,446 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 14:36:24,446 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:24,447 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf/c4f49c9c2721458da88de01d860ee54c] hfiles 2023-07-12 14:36:24,447 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf/c4f49c9c2721458da88de01d860ee54c for snapshot=snaptb0-testExportWithTargetName 2023-07-12 14:36:24,448 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58, entries=47, sequenceid=6, filesize=12.8 K 2023-07-12 14:36:24,454 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1fc7af4b18a0d9d974f056ae53bccf7d in 465ms, sequenceid=6, compaction requested=false 2023-07-12 14:36:24,454 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1fc7af4b18a0d9d974f056ae53bccf7d: 2023-07-12 14:36:24,455 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 14:36:24,455 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:24,455 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58] hfiles 2023-07-12 14:36:24,455 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 14:36:24,516 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. completed. 2023-07-12 14:36:24,516 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:24,516 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:24,516 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:24,516 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,516 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 14:36:24,516 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:36:24,518 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 14:36:24,518 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,519 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:24,519 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 14:36:24,522 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. completed. 2023-07-12 14:36:24,522 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:24,522 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:24,522 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:24,522 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,522 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 14:36:24,522 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:36:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:24,523 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 14:36:24,524 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:24,524 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 14:36:24,524 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:24,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:36:24,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 14:36:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:24,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:24,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:36:24,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 14:36:24,548 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 14:36:24,548 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:36:24,548 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:36:24,548 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 14:36:24,548 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,550 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:24,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:24,551 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:24,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:24,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,552 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:24,553 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:24,556 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 14:36:24,556 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,557 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:24,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:24,883 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:24,885 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,885 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:24,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 14:36:24,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 14:36:24,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 14:36:24,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:36:24,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:24,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:24,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:24,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:24,884 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:24,885 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 14:36:24,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:24,885 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:24,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:24,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:24,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:24,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712b11b76feba0c4be887930d9b6e975215, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071274d6116aabf34f07b6eedf85e95ddc7e] mob files 2023-07-12 14:36:24,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712b11b76feba0c4be887930d9b6e975215 2023-07-12 14:36:24,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071274d6116aabf34f07b6eedf85e95ddc7e 2023-07-12 14:36:24,900 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:24,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:24,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:24,904 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-12 14:36:24,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 14:36:24,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 14:36:25,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 14:36:25,143 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 14:36:25,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 14:36:25,143 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 14:36:25,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689172583773Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689172584984 (+1211 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689172584984Loading Region manifests for snaptb0-testExportWithTargetName at 1689172584985 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689172584998 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689172585039 (+41 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689172585143 (+104 ms) 2023-07-12 14:36:25,146 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 14:36:25,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3710 sec 2023-07-12 14:36:25,904 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:25,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 14:36:25,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:36:25,908 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908 2023-07-12 14:36:25,909 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:36845, tgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908, rawTgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:25,956 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:25,956 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-166539223_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 14:36:25,956 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 14:36:25,997 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 14:36:26,264 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:26,275 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:26,276 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:26,276 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,278 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:36:27,751 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-963769622359562954.jar 2023-07-12 14:36:27,752 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,752 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,852 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-8691899484696171229.jar 2023-07-12 14:36:27,852 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,853 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,854 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,855 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,855 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,856 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:27,857 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:36:27,857 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:36:27,858 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:36:27,859 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:36:27,859 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:36:27,860 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:36:27,860 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:36:27,868 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:36:27,869 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:36:27,870 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:36:27,885 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:27,886 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:27,886 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:36:27,886 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:27,887 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:27,888 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:36:27,888 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:36:29,308 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:36:29,317 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 14:36:29,327 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 14:36:30,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:36:30,285 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:36:30,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0001_000001 (auth:SIMPLE) 2023-07-12 14:36:36,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0001_000001 (auth:SIMPLE) 2023-07-12 14:36:38,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0001_000001 (auth:SIMPLE) 2023-07-12 14:36:43,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0001_000001 (auth:SIMPLE) 2023-07-12 14:36:44,705 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:36:44,706 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:36:44,717 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 14:36:44,717 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:36:44,718 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:36:44,718 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 14:36:44,719 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 14:36:44,719 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 14:36:44,720 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908/.hbase-snapshot/testExportWithTargetName 2023-07-12 14:36:44,720 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 14:36:44,720 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172585908/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 14:36:44,734 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 14:36:44,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-07-12 14:36:44,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:44,761 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172604761"}]},"ts":"1689172604761"} 2023-07-12 14:36:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 14:36:44,764 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 14:36:44,766 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 14:36:44,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, UNASSIGN}] 2023-07-12 14:36:44,771 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, UNASSIGN 2023-07-12 14:36:44,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, UNASSIGN 2023-07-12 14:36:44,773 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1fc7af4b18a0d9d974f056ae53bccf7d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:44,773 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e61b338ede929a449180ebe6753bb053, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:44,773 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172604773"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172604773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172604773"}]},"ts":"1689172604773"} 2023-07-12 14:36:44,773 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172604773"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172604773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172604773"}]},"ts":"1689172604773"} 2023-07-12 14:36:44,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 1fc7af4b18a0d9d974f056ae53bccf7d, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:36:44,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e61b338ede929a449180ebe6753bb053, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:36:44,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 14:36:44,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:44,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1fc7af4b18a0d9d974f056ae53bccf7d, disabling compactions & flushes 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e61b338ede929a449180ebe6753bb053, disabling compactions & flushes 2023-07-12 14:36:44,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:44,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. after waiting 0 ms 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. after waiting 0 ms 2023-07-12 14:36:44,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:44,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:36:44,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:36:44,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:36:44,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:36:44,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d. 2023-07-12 14:36:44,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1fc7af4b18a0d9d974f056ae53bccf7d: 2023-07-12 14:36:44,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053. 2023-07-12 14:36:44,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e61b338ede929a449180ebe6753bb053: 2023-07-12 14:36:44,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:44,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e61b338ede929a449180ebe6753bb053, regionState=CLOSED 2023-07-12 14:36:44,954 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172604953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172604953"}]},"ts":"1689172604953"} 2023-07-12 14:36:44,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:44,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1fc7af4b18a0d9d974f056ae53bccf7d, regionState=CLOSED 2023-07-12 14:36:44,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689172604954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172604954"}]},"ts":"1689172604954"} 2023-07-12 14:36:44,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 14:36:44,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e61b338ede929a449180ebe6753bb053, server=jenkins-hbase17.apache.org,35687,1689172568342 in 179 msec 2023-07-12 14:36:44,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 14:36:44,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 1fc7af4b18a0d9d974f056ae53bccf7d, server=jenkins-hbase17.apache.org,36691,1689172568228 in 181 msec 2023-07-12 14:36:44,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e61b338ede929a449180ebe6753bb053, UNASSIGN in 193 msec 2023-07-12 14:36:44,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 14:36:44,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1fc7af4b18a0d9d974f056ae53bccf7d, UNASSIGN in 196 msec 2023-07-12 14:36:44,971 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172604970"}]},"ts":"1689172604970"} 2023-07-12 14:36:44,973 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 14:36:44,978 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 14:36:44,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 234 msec 2023-07-12 14:36:45,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 14:36:45,065 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 14:36:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-07-12 14:36:45,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:45,079 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:45,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 14:36:45,081 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:45,084 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 14:36:45,086 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 14:36:45,086 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 14:36:45,086 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 14:36:45,086 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 14:36:45,087 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:45,087 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:45,087 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,088 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 14:36:45,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 14:36:45,088 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 14:36:45,088 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 14:36:45,088 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,088 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,089 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 14:36:45,089 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 14:36:45,089 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 14:36:45,089 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 14:36:45,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/recovered.edits] 2023-07-12 14:36:45,091 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/recovered.edits] 2023-07-12 14:36:45,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 14:36:45,098 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/cf/b4ad8ef872ee474fbf8f9f6f9d9a3e58 2023-07-12 14:36:45,098 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf/c4f49c9c2721458da88de01d860ee54c to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/cf/c4f49c9c2721458da88de01d860ee54c 2023-07-12 14:36:45,103 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053/recovered.edits/9.seqid 2023-07-12 14:36:45,103 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d/recovered.edits/9.seqid 2023-07-12 14:36:45,105 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/e61b338ede929a449180ebe6753bb053 2023-07-12 14:36:45,105 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportWithTargetName/1fc7af4b18a0d9d974f056ae53bccf7d 2023-07-12 14:36:45,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 14:36:45,106 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 14:36:45,107 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 14:36:45,112 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712b11b76feba0c4be887930d9b6e975215 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712b11b76feba0c4be887930d9b6e975215 2023-07-12 14:36:45,113 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071274d6116aabf34f07b6eedf85e95ddc7e to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071274d6116aabf34f07b6eedf85e95ddc7e 2023-07-12 14:36:45,114 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 14:36:45,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:45,136 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 14:36:45,139 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 14:36:45,140 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:45,140 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 14:36:45,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172605140"}]},"ts":"9223372036854775807"} 2023-07-12 14:36:45,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172605140"}]},"ts":"9223372036854775807"} 2023-07-12 14:36:45,143 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 14:36:45,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e61b338ede929a449180ebe6753bb053, NAME => 'testtb-testExportWithTargetName,,1689172580646.e61b338ede929a449180ebe6753bb053.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1fc7af4b18a0d9d974f056ae53bccf7d, NAME => 'testtb-testExportWithTargetName,1,1689172580646.1fc7af4b18a0d9d974f056ae53bccf7d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 14:36:45,143 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 14:36:45,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172605143"}]},"ts":"9223372036854775807"} 2023-07-12 14:36:45,145 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 14:36:45,147 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 14:36:45,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 76 msec 2023-07-12 14:36:45,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 14:36:45,194 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 14:36:45,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 14:36:45,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 14:36:45,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 14:36:45,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 14:36:45,253 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 704) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:44246 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1748699670_1 at /127.0.0.1:53658 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:41177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1748699670_1 at /127.0.0.1:43340 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1321 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:45569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:53674 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:46033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:43358 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=596 (was 527) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=1417 (was 3451) 2023-07-12 14:36:45,253 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 14:36:45,278 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=596, ProcessCount=183, AvailableMemoryMB=1415 2023-07-12 14:36:45,278 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 14:36:45,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 14:36:45,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:36:45,286 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:36:45,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 14:36:45,289 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:36:45,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 14:36:45,292 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,292 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,293 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c empty. 2023-07-12 14:36:45,293 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e empty. 2023-07-12 14:36:45,293 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,293 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,293 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 14:36:45,310 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 14:36:45,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea04ce7f35e8c3f9490af9b9605f7f0e, NAME => 'testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:36:45,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4ba7bd80397e04321acbb516a836307c, NAME => 'testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:36:45,385 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:45,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing ea04ce7f35e8c3f9490af9b9605f7f0e, disabling compactions & flushes 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4ba7bd80397e04321acbb516a836307c, disabling compactions & flushes 2023-07-12 14:36:45,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. after waiting 0 ms 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for ea04ce7f35e8c3f9490af9b9605f7f0e: 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. after waiting 0 ms 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,389 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,389 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4ba7bd80397e04321acbb516a836307c: 2023-07-12 14:36:45,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 14:36:45,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:36:45,395 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172605395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172605395"}]},"ts":"1689172605395"} 2023-07-12 14:36:45,395 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172605395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172605395"}]},"ts":"1689172605395"} 2023-07-12 14:36:45,398 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:36:45,399 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:36:45,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172605399"}]},"ts":"1689172605399"} 2023-07-12 14:36:45,401 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 14:36:45,403 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:36:45,404 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:36:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:36:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:36:45,405 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:36:45,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, ASSIGN}] 2023-07-12 14:36:45,408 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, ASSIGN 2023-07-12 14:36:45,408 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, ASSIGN 2023-07-12 14:36:45,409 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:36:45,409 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35687,1689172568342; forceNewPlan=false, retain=false 2023-07-12 14:36:45,559 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:36:45,561 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ea04ce7f35e8c3f9490af9b9605f7f0e, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:45,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4ba7bd80397e04321acbb516a836307c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:45,561 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172605561"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172605561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172605561"}]},"ts":"1689172605561"} 2023-07-12 14:36:45,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172605561"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172605561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172605561"}]},"ts":"1689172605561"} 2023-07-12 14:36:45,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure ea04ce7f35e8c3f9490af9b9605f7f0e, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:36:45,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 4ba7bd80397e04321acbb516a836307c, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:36:45,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 14:36:45,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea04ce7f35e8c3f9490af9b9605f7f0e, NAME => 'testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 14:36:45,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ba7bd80397e04321acbb516a836307c, NAME => 'testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 14:36:45,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. service=AccessControlService 2023-07-12 14:36:45,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. service=AccessControlService 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:45,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,721 INFO [StoreOpener-4ba7bd80397e04321acbb516a836307c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,721 INFO [StoreOpener-ea04ce7f35e8c3f9490af9b9605f7f0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,722 DEBUG [StoreOpener-4ba7bd80397e04321acbb516a836307c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf 2023-07-12 14:36:45,723 DEBUG [StoreOpener-ea04ce7f35e8c3f9490af9b9605f7f0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf 2023-07-12 14:36:45,723 DEBUG [StoreOpener-4ba7bd80397e04321acbb516a836307c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf 2023-07-12 14:36:45,723 DEBUG [StoreOpener-ea04ce7f35e8c3f9490af9b9605f7f0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf 2023-07-12 14:36:45,723 INFO [StoreOpener-4ba7bd80397e04321acbb516a836307c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ba7bd80397e04321acbb516a836307c columnFamilyName cf 2023-07-12 14:36:45,723 INFO [StoreOpener-ea04ce7f35e8c3f9490af9b9605f7f0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea04ce7f35e8c3f9490af9b9605f7f0e columnFamilyName cf 2023-07-12 14:36:45,724 INFO [StoreOpener-ea04ce7f35e8c3f9490af9b9605f7f0e-1] regionserver.HStore(310): Store=ea04ce7f35e8c3f9490af9b9605f7f0e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:45,724 INFO [StoreOpener-4ba7bd80397e04321acbb516a836307c-1] regionserver.HStore(310): Store=4ba7bd80397e04321acbb516a836307c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:36:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:36:45,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:36:45,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:45,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:36:45,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4ba7bd80397e04321acbb516a836307c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67717396, jitterRate=0.009067833423614502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:45,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ea04ce7f35e8c3f9490af9b9605f7f0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70177560, jitterRate=0.04572713375091553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:36:45,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4ba7bd80397e04321acbb516a836307c: 2023-07-12 14:36:45,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ea04ce7f35e8c3f9490af9b9605f7f0e: 2023-07-12 14:36:45,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c., pid=31, masterSystemTime=1689172605716 2023-07-12 14:36:45,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e., pid=30, masterSystemTime=1689172605716 2023-07-12 14:36:45,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:45,736 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4ba7bd80397e04321acbb516a836307c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:45,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,736 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172605736"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172605736"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172605736"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172605736"}]},"ts":"1689172605736"} 2023-07-12 14:36:45,737 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ea04ce7f35e8c3f9490af9b9605f7f0e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:45,737 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172605737"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172605737"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172605737"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172605737"}]},"ts":"1689172605737"} 2023-07-12 14:36:45,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 14:36:45,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 4ba7bd80397e04321acbb516a836307c, server=jenkins-hbase17.apache.org,36691,1689172568228 in 173 msec 2023-07-12 14:36:45,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 14:36:45,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure ea04ce7f35e8c3f9490af9b9605f7f0e, server=jenkins-hbase17.apache.org,35687,1689172568342 in 175 msec 2023-07-12 14:36:45,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, ASSIGN in 336 msec 2023-07-12 14:36:45,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 14:36:45,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, ASSIGN in 338 msec 2023-07-12 14:36:45,747 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:36:45,747 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172605747"}]},"ts":"1689172605747"} 2023-07-12 14:36:45,749 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 14:36:45,751 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:36:45,752 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 14:36:45,754 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 14:36:45,755 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,755 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,755 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,755 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:36:45,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:45,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:45,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:45,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:36:45,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 475 msec 2023-07-12 14:36:45,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 14:36:45,894 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 14:36:45,897 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 14:36:45,897 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:45,900 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:36:45,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:36:45,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172605919 (current time:1689172605919). 2023-07-12 14:36:45,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:36:45,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x2c46cdcc to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:46,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c31d5a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:46,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:46,020 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c46cdcc to 127.0.0.1:61257 2023-07-12 14:36:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:46,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x5edd3c19 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:46,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@446fb2a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:46,042 DEBUG [hconnection-0x6651d36d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:46,043 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:46,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5edd3c19 to 127.0.0.1:61257 2023-07-12 14:36:46,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:46,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 14:36:46,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:36:46,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:36:46,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:36:46,058 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:36:46,059 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689173206059 2023-07-12 14:36:46,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 14:36:46,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:36:46,060 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:36:46,060 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:36:46,066 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:36:46,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 14:36:46,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-12 14:36:46,071 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 14:36:46,072 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689173206072 2023-07-12 14:36:46,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,110 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 14:36:46,110 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:46,112 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 14:36:46,113 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 14:36:46,113 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,113 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,114 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:46,114 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:46,114 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:46,114 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:46,114 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,115 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,115 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,115 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:36:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 14:36:46,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,117 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 14:36:46,117 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:46,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,119 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 14:36:46,119 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 14:36:46,119 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 14:36:46,120 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:46,120 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 14:36:46,120 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:46,121 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 14:36:46,120 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 14:36:46,123 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 14:36:46,123 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 14:36:46,123 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 14:36:46,124 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 14:36:46,124 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 14:36:46,125 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,125 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:46,129 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,129 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,129 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:46,129 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,129 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:46,130 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,130 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:46,130 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,130 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:46,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:46,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118b4e8f[Count = 1] remaining members to acquire global barrier 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:46,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 14:36:46,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118b4e8f[Count = 0] remaining members to acquire global barrier 2023-07-12 14:36:46,134 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 14:36:46,134 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,135 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,135 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,135 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,137 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:36:46,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:36:46,137 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,137 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:46,137 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:46,137 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:46,137 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. started... 2023-07-12 14:36:46,137 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:46,137 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. started... 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ba7bd80397e04321acbb516a836307c: 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea04ce7f35e8c3f9490af9b9605f7f0e: 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,139 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:46,140 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:36:46,140 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 14:36:46,140 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:46,140 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 14:36:46,151 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. completed. 2023-07-12 14:36:46,151 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:46,151 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:46,152 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:46,152 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,152 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 14:36:46,152 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:36:46,153 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:46,153 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 14:36:46,153 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:46,153 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 14:36:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:46,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:36:46,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 14:36:46,160 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:46,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:36:46,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:46,162 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:36:46,170 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. completed. 2023-07-12 14:36:46,170 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:46,170 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:46,170 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:46,170 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,170 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 14:36:46,170 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:36:46,171 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 14:36:46,171 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:46,172 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 14:36:46,173 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:36:46,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 14:36:46,183 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 14:36:46,183 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:36:46,183 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:36:46,183 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,183 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:36:46,185 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,185 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:46,186 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:46,186 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,185 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:46,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:46,186 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:46,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:46,187 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:46,188 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,190 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,190 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,190 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:46,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:46,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:46,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:46,193 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:46,195 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:46,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:46,195 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:46,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:46,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:46,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,193 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,196 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 14:36:46,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:46,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:46,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:46,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:46,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:46,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,196 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:36:46,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:46,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:46,196 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:46,196 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,196 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:46,197 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:46,197 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,197 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 14:36:46,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,362 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:46,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:36:46,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:46,363 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 14:36:46,664 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:46,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:36:46,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:46,668 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 14:36:46,677 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 14:36:46,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,678 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 14:36:46,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689172606059Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689172606206 (+147 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689172606206Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689172606206Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689172606219 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689172606230 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689172606677 (+447 ms) 2023-07-12 14:36:46,681 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 14:36:46,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 616 msec 2023-07-12 14:36:46,998 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 14:36:47,168 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:47,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:36:47,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:36:47,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35687] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:36:47,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36691] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:36:47,184 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 14:36:47,184 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:47,184 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:36:47,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:36:47,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172607197 (current time:1689172607197). 2023-07-12 14:36:47,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:36:47,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x16ed7d84 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:47,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52cb71bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:47,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:47,210 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:47,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16ed7d84 to 127.0.0.1:61257 2023-07-12 14:36:47,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:47,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x716ce965 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:36:47,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55f4511, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:36:47,223 DEBUG [hconnection-0x3920f987-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:36:47,226 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:36:47,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x716ce965 to 127.0.0.1:61257 2023-07-12 14:36:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:36:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 14:36:47,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:36:47,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:36:47,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:36:47,238 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:36:47,239 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689173207239 2023-07-12 14:36:47,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:36:47,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 14:36:47,241 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:36:47,241 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:36:47,242 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:36:47,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 14:36:47,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-12 14:36:47,245 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 14:36:47,246 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689173207246 2023-07-12 14:36:47,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 14:36:47,261 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 14:36:47,261 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:47,262 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 14:36:47,262 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 14:36:47,263 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,263 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,264 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:47,264 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:47,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:47,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:47,264 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,264 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:47,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,264 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,264 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,265 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 14:36:47,265 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 14:36:47,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 14:36:47,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 14:36:47,266 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 14:36:47,266 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 14:36:47,265 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:47,266 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:47,267 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 14:36:47,268 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 14:36:47,266 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:36:47,268 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 14:36:47,268 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 14:36:47,270 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 14:36:47,270 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 14:36:47,270 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 14:36:47,270 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 14:36:47,270 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 14:36:47,271 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,271 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:47,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:47,272 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,272 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,272 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,272 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:47,272 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:47,272 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,273 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:47,273 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,273 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:36:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:47,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 14:36:47,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@562beed1[Count = 1] remaining members to acquire global barrier 2023-07-12 14:36:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:47,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 14:36:47,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@562beed1[Count = 0] remaining members to acquire global barrier 2023-07-12 14:36:47,277 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 14:36:47,277 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:36:47,278 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,278 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:36:47,278 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 14:36:47,278 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:36:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,279 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:36:47,279 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,279 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:36:47,280 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 14:36:47,280 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:47,280 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 14:36:47,284 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:47,286 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:47,286 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:47,286 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. started... 2023-07-12 14:36:47,286 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:36:47,286 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:47,286 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:36:47,286 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. started... 2023-07-12 14:36:47,286 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4ba7bd80397e04321acbb516a836307c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 14:36:47,286 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ea04ce7f35e8c3f9490af9b9605f7f0e 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 14:36:47,322 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712bd485148ed1a41f295ad31bf024c591a to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712bd485148ed1a41f295ad31bf024c591a 2023-07-12 14:36:47,329 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712696f168260ad47df8e32d3e1633de4ba to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712696f168260ad47df8e32d3e1633de4ba 2023-07-12 14:36:47,341 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:47,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:36:47,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:36:47,343 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:36:47,344 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/.tmp/cf/fa1d38bc69d44b3f8ad39811930ec4a4 2023-07-12 14:36:47,352 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/.tmp/cf/fa1d38bc69d44b3f8ad39811930ec4a4 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf/fa1d38bc69d44b3f8ad39811930ec4a4 2023-07-12 14:36:47,356 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/.tmp/cf/ebf344cf4eca4a948850d0b5a02d57e0 2023-07-12 14:36:47,360 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf/fa1d38bc69d44b3f8ad39811930ec4a4, entries=48, sequenceid=6, filesize=13.0 K 2023-07-12 14:36:47,365 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/.tmp/cf/ebf344cf4eca4a948850d0b5a02d57e0 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf/ebf344cf4eca4a948850d0b5a02d57e0 2023-07-12 14:36:47,366 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4ba7bd80397e04321acbb516a836307c in 80ms, sequenceid=6, compaction requested=false 2023-07-12 14:36:47,367 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ba7bd80397e04321acbb516a836307c: 2023-07-12 14:36:47,367 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 14:36:47,368 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:47,368 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf/fa1d38bc69d44b3f8ad39811930ec4a4] hfiles 2023-07-12 14:36:47,368 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf/fa1d38bc69d44b3f8ad39811930ec4a4 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 14:36:47,375 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf/ebf344cf4eca4a948850d0b5a02d57e0, entries=2, sequenceid=6, filesize=5.2 K 2023-07-12 14:36:47,376 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ea04ce7f35e8c3f9490af9b9605f7f0e in 90ms, sequenceid=6, compaction requested=false 2023-07-12 14:36:47,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea04ce7f35e8c3f9490af9b9605f7f0e: 2023-07-12 14:36:47,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 14:36:47,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:36:47,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf/ebf344cf4eca4a948850d0b5a02d57e0] hfiles 2023-07-12 14:36:47,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf/ebf344cf4eca4a948850d0b5a02d57e0 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 14:36:47,387 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. completed. 2023-07-12 14:36:47,387 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:36:47,387 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:47,387 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:47,387 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,387 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 14:36:47,387 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:36:47,391 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 14:36:47,391 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,391 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,393 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. completed. 2023-07-12 14:36:47,391 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 14:36:47,393 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:36:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:47,393 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:36:47,393 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:36:47,393 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:47,393 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 14:36:47,393 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:36:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:47,394 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,394 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 14:36:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:47,394 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:47,394 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 14:36:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:36:47,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 14:36:47,402 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 14:36:47,402 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:36:47,402 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:36:47,402 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 14:36:47,402 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:36:47,403 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:47,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:36:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:36:47,403 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:47,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:36:47,404 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,404 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:36:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:36:47,405 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 14:36:47,406 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,406 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,406 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,406 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:47,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:36:47,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:47,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:47,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:36:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:47,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 14:36:47,408 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,408 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:36:47,410 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:47,409 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 14:36:47,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:47,410 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:36:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:36:47,410 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:36:47,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 14:36:47,410 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:36:47,410 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:36:47,411 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:36:47,411 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,411 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712bd485148ed1a41f295ad31bf024c591a, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712696f168260ad47df8e32d3e1633de4ba] mob files 2023-07-12 14:36:47,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712bd485148ed1a41f295ad31bf024c591a 2023-07-12 14:36:47,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712696f168260ad47df8e32d3e1633de4ba 2023-07-12 14:36:47,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 14:36:47,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 14:36:47,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,465 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689172607239Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689172607419 (+180 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689172607419Loading Region manifests for snaptb0-testExportFileSystemState at 1689172607419Writing data manifest for snaptb0-testExportFileSystemState at 1689172607423 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689172607436 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689172607465 (+29 ms) 2023-07-12 14:36:47,468 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 14:36:47,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 227 msec 2023-07-12 14:36:47,543 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:36:47,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:36:47,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:36:47,545 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545 2023-07-12 14:36:47,545 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:36845, tgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545, rawTgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:47,580 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:36:47,580 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418932107_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,580 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 14:36:47,596 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 14:36:47,627 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:47,628 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:47,628 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:47,629 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,549 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-7812588135398397233.jar 2023-07-12 14:36:48,550 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,550 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,618 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-5111687089028765521.jar 2023-07-12 14:36:48,619 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,619 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,620 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,620 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,620 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,621 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:36:48,621 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:36:48,621 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:36:48,622 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:36:48,622 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:36:48,622 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:36:48,623 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:36:48,623 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:36:48,623 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:36:48,624 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:36:48,624 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:36:48,625 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:48,625 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:48,625 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:36:48,626 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:48,626 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:36:48,627 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:36:48,627 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:36:49,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0001_000001 (auth:SIMPLE) 2023-07-12 14:36:50,302 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:36:50,310 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 14:36:50,314 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 14:36:50,632 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:36:50,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:36:50,941 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:36:51,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0002_000001 (auth:SIMPLE) 2023-07-12 14:36:56,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0002_000001 (auth:SIMPLE) 2023-07-12 14:36:58,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0002_000001 (auth:SIMPLE) 2023-07-12 14:37:02,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0002_000001 (auth:SIMPLE) 2023-07-12 14:37:03,415 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:37:03,418 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:37:03,436 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 14:37:03,437 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:37:03,437 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:37:03,438 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 14:37:03,438 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 14:37:03,439 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 14:37:03,439 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 14:37:03,440 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 14:37:03,440 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172607545/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 14:37:03,453 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 14:37:03,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-07-12 14:37:03,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 14:37:03,462 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172623462"}]},"ts":"1689172623462"} 2023-07-12 14:37:03,465 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 14:37:03,466 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 14:37:03,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, UNASSIGN}] 2023-07-12 14:37:03,469 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, UNASSIGN 2023-07-12 14:37:03,469 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, UNASSIGN 2023-07-12 14:37:03,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4ba7bd80397e04321acbb516a836307c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:03,471 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ea04ce7f35e8c3f9490af9b9605f7f0e, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:03,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172623470"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172623470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172623470"}]},"ts":"1689172623470"} 2023-07-12 14:37:03,471 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172623471"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172623471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172623471"}]},"ts":"1689172623471"} 2023-07-12 14:37:03,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure ea04ce7f35e8c3f9490af9b9605f7f0e, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:37:03,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 4ba7bd80397e04321acbb516a836307c, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:37:03,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 14:37:03,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:37:03,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ea04ce7f35e8c3f9490af9b9605f7f0e, disabling compactions & flushes 2023-07-12 14:37:03,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:37:03,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:37:03,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. after waiting 0 ms 2023-07-12 14:37:03,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:37:03,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:37:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4ba7bd80397e04321acbb516a836307c, disabling compactions & flushes 2023-07-12 14:37:03,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:37:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:37:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. after waiting 0 ms 2023-07-12 14:37:03,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:37:03,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:37:03,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:37:03,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:37:03,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e. 2023-07-12 14:37:03,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ea04ce7f35e8c3f9490af9b9605f7f0e: 2023-07-12 14:37:03,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:37:03,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c. 2023-07-12 14:37:03,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4ba7bd80397e04321acbb516a836307c: 2023-07-12 14:37:03,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:37:03,664 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ea04ce7f35e8c3f9490af9b9605f7f0e, regionState=CLOSED 2023-07-12 14:37:03,664 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172623664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172623664"}]},"ts":"1689172623664"} 2023-07-12 14:37:03,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4ba7bd80397e04321acbb516a836307c 2023-07-12 14:37:03,665 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4ba7bd80397e04321acbb516a836307c, regionState=CLOSED 2023-07-12 14:37:03,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689172623665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172623665"}]},"ts":"1689172623665"} 2023-07-12 14:37:03,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-12 14:37:03,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure ea04ce7f35e8c3f9490af9b9605f7f0e, server=jenkins-hbase17.apache.org,35687,1689172568342 in 190 msec 2023-07-12 14:37:03,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-12 14:37:03,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea04ce7f35e8c3f9490af9b9605f7f0e, UNASSIGN in 202 msec 2023-07-12 14:37:03,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 4ba7bd80397e04321acbb516a836307c, server=jenkins-hbase17.apache.org,36691,1689172568228 in 189 msec 2023-07-12 14:37:03,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-12 14:37:03,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4ba7bd80397e04321acbb516a836307c, UNASSIGN in 205 msec 2023-07-12 14:37:03,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172623675"}]},"ts":"1689172623675"} 2023-07-12 14:37:03,676 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 14:37:03,677 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 14:37:03,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 225 msec 2023-07-12 14:37:03,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 14:37:03,763 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 14:37:03,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-07-12 14:37:03,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,767 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 14:37:03,768 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,769 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 14:37:03,771 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,771 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,771 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,771 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:03,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 14:37:03,773 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 14:37:03,773 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:03,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 14:37:03,774 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:37:03,774 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c 2023-07-12 14:37:03,776 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/recovered.edits] 2023-07-12 14:37:03,776 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/recovered.edits] 2023-07-12 14:37:03,780 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf/ebf344cf4eca4a948850d0b5a02d57e0 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/cf/ebf344cf4eca4a948850d0b5a02d57e0 2023-07-12 14:37:03,780 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf/fa1d38bc69d44b3f8ad39811930ec4a4 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/cf/fa1d38bc69d44b3f8ad39811930ec4a4 2023-07-12 14:37:03,782 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e/recovered.edits/9.seqid 2023-07-12 14:37:03,782 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c/recovered.edits/9.seqid 2023-07-12 14:37:03,783 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/ea04ce7f35e8c3f9490af9b9605f7f0e 2023-07-12 14:37:03,783 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemState/4ba7bd80397e04321acbb516a836307c 2023-07-12 14:37:03,783 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 14:37:03,783 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 14:37:03,784 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 14:37:03,787 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712bd485148ed1a41f295ad31bf024c591a to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712bd485148ed1a41f295ad31bf024c591a 2023-07-12 14:37:03,789 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712696f168260ad47df8e32d3e1633de4ba to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712696f168260ad47df8e32d3e1633de4ba 2023-07-12 14:37:03,789 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 14:37:03,792 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,795 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 14:37:03,797 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 14:37:03,798 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,798 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 14:37:03,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172623798"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:03,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172623798"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:03,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 14:37:03,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ea04ce7f35e8c3f9490af9b9605f7f0e, NAME => 'testtb-testExportFileSystemState,,1689172605280.ea04ce7f35e8c3f9490af9b9605f7f0e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4ba7bd80397e04321acbb516a836307c, NAME => 'testtb-testExportFileSystemState,1,1689172605280.4ba7bd80397e04321acbb516a836307c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 14:37:03,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 14:37:03,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172623801"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:03,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 14:37:03,805 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 14:37:03,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-07-12 14:37:03,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 14:37:03,876 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 14:37:03,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 14:37:03,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 14:37:03,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 14:37:03,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 14:37:03,927 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758 (was 751) Potentially hanging thread: Thread-2151 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:34087 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:54108 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2127814183_1 at /127.0.0.1:54088 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:53138 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:42579 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:57702 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2127814183_1 at /127.0.0.1:57674 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=606 (was 596) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1440 (was 1415) - AvailableMemoryMB LEAK? - 2023-07-12 14:37:03,927 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 14:37:03,954 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=758, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=606, ProcessCount=183, AvailableMemoryMB=1439 2023-07-12 14:37:03,954 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 14:37:03,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 14:37:03,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:03,963 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:37:03,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 14:37:03,964 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:37:03,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 14:37:03,967 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:03,967 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:03,968 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd empty. 2023-07-12 14:37:03,968 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 empty. 2023-07-12 14:37:03,968 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:03,968 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:03,968 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 14:37:03,986 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 14:37:03,987 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 74ee7edab995b2288e248557db77fbcd, NAME => 'testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:37:03,987 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3e580bd130fa74bb292692585ad343c7, NAME => 'testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:37:04,008 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:04,009 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 74ee7edab995b2288e248557db77fbcd, disabling compactions & flushes 2023-07-12 14:37:04,009 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,009 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,009 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. after waiting 0 ms 2023-07-12 14:37:04,009 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,009 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,009 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 74ee7edab995b2288e248557db77fbcd: 2023-07-12 14:37:04,010 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:04,010 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3e580bd130fa74bb292692585ad343c7, disabling compactions & flushes 2023-07-12 14:37:04,010 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,010 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,010 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. after waiting 0 ms 2023-07-12 14:37:04,010 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,010 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,010 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3e580bd130fa74bb292692585ad343c7: 2023-07-12 14:37:04,012 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:37:04,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172624013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172624013"}]},"ts":"1689172624013"} 2023-07-12 14:37:04,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172624013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172624013"}]},"ts":"1689172624013"} 2023-07-12 14:37:04,016 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:37:04,017 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:37:04,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172624017"}]},"ts":"1689172624017"} 2023-07-12 14:37:04,019 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 14:37:04,021 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:37:04,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:37:04,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:37:04,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:37:04,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:37:04,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, ASSIGN}] 2023-07-12 14:37:04,028 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, ASSIGN 2023-07-12 14:37:04,028 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, ASSIGN 2023-07-12 14:37:04,029 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:37:04,029 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35263,1689172568285; forceNewPlan=false, retain=false 2023-07-12 14:37:04,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 14:37:04,180 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:37:04,183 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3e580bd130fa74bb292692585ad343c7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=74ee7edab995b2288e248557db77fbcd, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,183 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172624183"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172624183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172624183"}]},"ts":"1689172624183"} 2023-07-12 14:37:04,183 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172624183"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172624183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172624183"}]},"ts":"1689172624183"} 2023-07-12 14:37:04,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 3e580bd130fa74bb292692585ad343c7, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:37:04,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 74ee7edab995b2288e248557db77fbcd, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:37:04,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 14:37:04,338 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,338 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 14:37:04,343 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 14:37:04,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 74ee7edab995b2288e248557db77fbcd, NAME => 'testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 14:37:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. service=AccessControlService 2023-07-12 14:37:04,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:04,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,350 INFO [StoreOpener-74ee7edab995b2288e248557db77fbcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e580bd130fa74bb292692585ad343c7, NAME => 'testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 14:37:04,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. service=AccessControlService 2023-07-12 14:37:04,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:04,353 DEBUG [StoreOpener-74ee7edab995b2288e248557db77fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf 2023-07-12 14:37:04,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,353 DEBUG [StoreOpener-74ee7edab995b2288e248557db77fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf 2023-07-12 14:37:04,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:04,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,354 INFO [StoreOpener-74ee7edab995b2288e248557db77fbcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74ee7edab995b2288e248557db77fbcd columnFamilyName cf 2023-07-12 14:37:04,355 INFO [StoreOpener-3e580bd130fa74bb292692585ad343c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,355 INFO [StoreOpener-74ee7edab995b2288e248557db77fbcd-1] regionserver.HStore(310): Store=74ee7edab995b2288e248557db77fbcd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:04,356 DEBUG [StoreOpener-3e580bd130fa74bb292692585ad343c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf 2023-07-12 14:37:04,356 DEBUG [StoreOpener-3e580bd130fa74bb292692585ad343c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf 2023-07-12 14:37:04,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,357 INFO [StoreOpener-3e580bd130fa74bb292692585ad343c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e580bd130fa74bb292692585ad343c7 columnFamilyName cf 2023-07-12 14:37:04,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,358 INFO [StoreOpener-3e580bd130fa74bb292692585ad343c7-1] regionserver.HStore(310): Store=3e580bd130fa74bb292692585ad343c7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:04,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:04,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:37:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:37:04,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 74ee7edab995b2288e248557db77fbcd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67895218, jitterRate=0.01171758770942688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:04,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 74ee7edab995b2288e248557db77fbcd: 2023-07-12 14:37:04,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3e580bd130fa74bb292692585ad343c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70921340, jitterRate=0.05681031942367554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:04,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3e580bd130fa74bb292692585ad343c7: 2023-07-12 14:37:04,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd., pid=46, masterSystemTime=1689172624338 2023-07-12 14:37:04,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7., pid=45, masterSystemTime=1689172624338 2023-07-12 14:37:04,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,381 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=74ee7edab995b2288e248557db77fbcd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,382 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172624381"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172624381"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172624381"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172624381"}]},"ts":"1689172624381"} 2023-07-12 14:37:04,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,385 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3e580bd130fa74bb292692585ad343c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,386 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172624385"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172624385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172624385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172624385"}]},"ts":"1689172624385"} 2023-07-12 14:37:04,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-12 14:37:04,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 74ee7edab995b2288e248557db77fbcd, server=jenkins-hbase17.apache.org,36691,1689172568228 in 200 msec 2023-07-12 14:37:04,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 14:37:04,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 3e580bd130fa74bb292692585ad343c7, server=jenkins-hbase17.apache.org,35263,1689172568285 in 203 msec 2023-07-12 14:37:04,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, ASSIGN in 368 msec 2023-07-12 14:37:04,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-12 14:37:04,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, ASSIGN in 369 msec 2023-07-12 14:37:04,396 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:37:04,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172624396"}]},"ts":"1689172624396"} 2023-07-12 14:37:04,398 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 14:37:04,400 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:37:04,401 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 14:37:04,403 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 14:37:04,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:04,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:04,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:04,405 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:04,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:04,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:04,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:04,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:04,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 450 msec 2023-07-12 14:37:04,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 14:37:04,568 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 14:37:04,572 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 14:37:04,572 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,575 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:37:04,587 DEBUG [hconnection-0x2a2dca43-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:04,594 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:04,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 14:37:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172624599 (current time:1689172624599). 2023-07-12 14:37:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:37:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x15d049a0 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:04,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c61e26b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:04,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:04,622 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:04,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15d049a0 to 127.0.0.1:61257 2023-07-12 14:37:04,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:04,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x57b17db2 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:04,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40bbb3ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:04,734 DEBUG [hconnection-0x131a736b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:04,741 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:04,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57b17db2 to 127.0.0.1:61257 2023-07-12 14:37:04,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:04,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 14:37:04,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:37:04,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 14:37:04,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 14:37:04,762 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 14:37:04,763 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689173224763 2023-07-12 14:37:04,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 14:37:04,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 14:37:04,765 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:37:04,765 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:37:04,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 14:37:04,767 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 14:37:04,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-12 14:37:04,771 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 14:37:04,772 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689173224771 2023-07-12 14:37:04,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,795 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 14:37:04,795 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:04,796 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 14:37:04,796 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 14:37:04,797 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,797 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,798 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,798 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:04,798 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:04,798 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,798 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,798 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,799 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,799 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:37:04,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 14:37:04,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 14:37:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 14:37:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 14:37:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 14:37:04,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,804 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 14:37:04,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,804 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:04,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 14:37:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 14:37:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 14:37:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 14:37:04,809 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 14:37:04,810 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 14:37:04,808 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 14:37:04,810 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 14:37:04,810 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:04,832 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 14:37:04,832 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 14:37:04,832 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 14:37:04,834 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,834 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,834 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:04,834 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,834 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,834 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,834 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,835 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:04,835 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:04,835 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,835 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:04,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 14:37:04,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b9bf422[Count = 1] remaining members to acquire global barrier 2023-07-12 14:37:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:04,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 14:37:04,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b9bf422[Count = 0] remaining members to acquire global barrier 2023-07-12 14:37:04,840 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 14:37:04,840 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,843 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,843 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 14:37:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 14:37:04,844 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 14:37:04,844 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:04,844 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. started... 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 14:37:04,844 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:37:04,845 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,845 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:37:04,845 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 14:37:04,845 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:04,846 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 14:37:04,854 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:04,854 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:04,854 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e580bd130fa74bb292692585ad343c7: 2023-07-12 14:37:04,854 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,854 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:04,854 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:37:04,865 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,867 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. started... 2023-07-12 14:37:04,866 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:04,867 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 74ee7edab995b2288e248557db77fbcd: 2023-07-12 14:37:04,867 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,867 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:04,867 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:37:04,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 14:37:04,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:37:04,869 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:37:04,900 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. completed. 2023-07-12 14:37:04,900 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:04,901 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:04,901 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:04,901 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,901 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 14:37:04,901 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:37:04,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,903 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 14:37:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:04,903 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:04,903 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 14:37:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:04,907 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. completed. 2023-07-12 14:37:04,907 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:04,907 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:04,907 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:04,907 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,907 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 14:37:04,907 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:37:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 14:37:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:04,910 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 14:37:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:04,911 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35263,1689172568285': 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:04,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:37:04,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 14:37:04,917 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 14:37:04,917 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:37:04,917 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:37:04,917 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,917 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:37:04,918 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,918 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:04,918 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:04,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,919 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,920 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:04,920 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,920 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,922 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:04,923 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,923 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,925 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:04,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:04,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:04,926 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:04,926 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:04,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:04,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 14:37:04,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:37:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:04,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:04,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:04,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 14:37:04,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:04,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:04,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:05,003 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 14:37:05,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:05,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 14:37:05,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:05,046 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:05,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689172624764Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689172624964 (+200 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689172624964Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689172624965 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689172624991 (+26 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689172625007 (+16 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689172625045 (+38 ms) 2023-07-12 14:37:05,048 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 14:37:05,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 283 msec 2023-07-12 14:37:05,069 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:05,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 14:37:05,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:37:05,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36691] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:37:05,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35263] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:37:05,081 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 14:37:05,081 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:05,081 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:37:05,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 14:37:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172625104 (current time:1689172625104). 2023-07-12 14:37:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:37:05,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x3ea2daac to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:05,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@575132a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:05,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:05,134 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:05,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ea2daac to 127.0.0.1:61257 2023-07-12 14:37:05,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:05,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x6c84fffb to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:05,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b1d07dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:05,162 DEBUG [hconnection-0x1dc3bfe3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:05,163 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:05,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c84fffb to 127.0.0.1:61257 2023-07-12 14:37:05,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:05,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 14:37:05,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:37:05,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 14:37:05,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 14:37:05,177 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 14:37:05,178 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689173225178 2023-07-12 14:37:05,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 14:37:05,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 14:37:05,180 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:37:05,181 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:37:05,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 14:37:05,186 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 14:37:05,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-12 14:37:05,190 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 14:37:05,191 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689173225191 2023-07-12 14:37:05,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 14:37:05,211 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 14:37:05,211 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:05,212 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 14:37:05,212 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 14:37:05,213 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,213 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,214 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,214 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:05,214 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:05,214 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,214 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,214 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 14:37:05,215 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 14:37:05,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 14:37:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 14:37:05,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 14:37:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 14:37:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 14:37:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 14:37:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 14:37:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 14:37:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:05,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 14:37:05,219 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:05,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 14:37:05,220 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,220 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 14:37:05,220 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:05,220 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:05,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 14:37:05,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd4e1b6[Count = 1] remaining members to acquire global barrier 2023-07-12 14:37:05,226 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 14:37:05,226 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 14:37:05,226 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 14:37:05,226 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 14:37:05,226 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 14:37:05,226 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 14:37:05,229 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,229 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,229 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:05,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:05,229 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,229 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,230 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:05,229 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:05,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:05,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:05,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:05,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 14:37:05,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd4e1b6[Count = 0] remaining members to acquire global barrier 2023-07-12 14:37:05,232 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 14:37:05,232 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,233 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,233 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,233 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 14:37:05,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,234 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 14:37:05,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:37:05,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:05,234 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:05,234 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,234 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:37:05,234 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:05,234 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:05,234 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. started... 2023-07-12 14:37:05,234 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. started... 2023-07-12 14:37:05,235 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 74ee7edab995b2288e248557db77fbcd 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 14:37:05,235 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e580bd130fa74bb292692585ad343c7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 14:37:05,235 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 14:37:05,235 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:05,235 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 14:37:05,274 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307121c2c33dd47494dea9b208f641388b067 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307121c2c33dd47494dea9b208f641388b067 2023-07-12 14:37:05,274 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071284b3bf39a12248ac9a4048b29663e161 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071284b3bf39a12248ac9a4048b29663e161 2023-07-12 14:37:05,281 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:05,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 14:37:05,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:37:05,282 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:37:05,288 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/.tmp/cf/2a032af16a624e71bae7c960ac0124b0 2023-07-12 14:37:05,291 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/.tmp/cf/a9983a46f47541c785c57b2cb9275cae 2023-07-12 14:37:05,297 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/.tmp/cf/2a032af16a624e71bae7c960ac0124b0 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf/2a032af16a624e71bae7c960ac0124b0 2023-07-12 14:37:05,299 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/.tmp/cf/a9983a46f47541c785c57b2cb9275cae as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf/a9983a46f47541c785c57b2cb9275cae 2023-07-12 14:37:05,303 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf/2a032af16a624e71bae7c960ac0124b0, entries=2, sequenceid=6, filesize=5.2 K 2023-07-12 14:37:05,305 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 74ee7edab995b2288e248557db77fbcd in 70ms, sequenceid=6, compaction requested=false 2023-07-12 14:37:05,307 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 74ee7edab995b2288e248557db77fbcd: 2023-07-12 14:37:05,307 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 14:37:05,307 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:05,307 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf/2a032af16a624e71bae7c960ac0124b0] hfiles 2023-07-12 14:37:05,307 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf/2a032af16a624e71bae7c960ac0124b0 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 14:37:05,310 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf/a9983a46f47541c785c57b2cb9275cae, entries=48, sequenceid=6, filesize=12.9 K 2023-07-12 14:37:05,311 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 3e580bd130fa74bb292692585ad343c7 in 76ms, sequenceid=6, compaction requested=false 2023-07-12 14:37:05,311 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e580bd130fa74bb292692585ad343c7: 2023-07-12 14:37:05,311 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 14:37:05,311 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:05,311 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf/a9983a46f47541c785c57b2cb9275cae] hfiles 2023-07-12 14:37:05,311 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf/a9983a46f47541c785c57b2cb9275cae for snapshot=snaptb0-testConsecutiveExports 2023-07-12 14:37:05,338 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. completed. 2023-07-12 14:37:05,338 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:37:05,339 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. completed. 2023-07-12 14:37:05,339 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 14:37:05,339 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:37:05,340 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 14:37:05,340 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,340 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:05,340 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 14:37:05,344 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 14:37:05,344 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:05,344 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 14:37:05,344 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:05,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:05,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:37:05,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 14:37:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:05,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35263,1689172568285': 2023-07-12 14:37:05,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 14:37:05,354 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 14:37:05,354 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:37:05,354 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:37:05,354 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 14:37:05,354 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:05,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:05,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,356 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:05,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:05,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:05,356 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:05,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:05,357 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,357 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:05,359 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 14:37:05,359 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,368 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,373 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:05,373 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:05,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:05,375 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:05,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 14:37:05,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 14:37:05,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:05,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:05,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 14:37:05,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:05,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:05,374 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,377 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:05,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:05,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071284b3bf39a12248ac9a4048b29663e161, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307121c2c33dd47494dea9b208f641388b067] mob files 2023-07-12 14:37:05,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071284b3bf39a12248ac9a4048b29663e161 2023-07-12 14:37:05,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307121c2c33dd47494dea9b208f641388b067 2023-07-12 14:37:05,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 14:37:05,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 14:37:05,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,452 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689172625179Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689172625388 (+209 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689172625388Loading Region manifests for snaptb0-testConsecutiveExports at 1689172625388Writing data manifest for snaptb0-testConsecutiveExports at 1689172625392 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689172625402 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689172625452 (+50 ms) 2023-07-12 14:37:05,455 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 14:37:05,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 275 msec 2023-07-12 14:37:05,483 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:05,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 14:37:05,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:37:05,484 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484 2023-07-12 14:37:05,484 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:37:05,507 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:37:05,507 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@42db4da3, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,507 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 14:37:05,516 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:05,529 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:05,530 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:05,530 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:05,531 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,530 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-2693972902541370856.jar 2023-07-12 14:37:06,530 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,531 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,600 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-6979050846847108393.jar 2023-07-12 14:37:06,601 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,601 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,602 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,602 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,603 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,603 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:06,603 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:37:06,604 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:37:06,604 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:37:06,604 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:37:06,605 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:37:06,605 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:37:06,606 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:37:06,606 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:37:06,606 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:37:06,607 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:37:06,607 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:06,608 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:06,608 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:06,608 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:06,609 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:06,609 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:06,610 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:07,054 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:37:07,056 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 14:37:07,059 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 14:37:08,505 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:37:08,505 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:37:08,508 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0002_000001 (auth:SIMPLE) 2023-07-12 14:37:09,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0003_000001 (auth:SIMPLE) 2023-07-12 14:37:09,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:37:14,225 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0003_000001 (auth:SIMPLE) 2023-07-12 14:37:16,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0003_000001 (auth:SIMPLE) 2023-07-12 14:37:18,791 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0003_000001 (auth:SIMPLE) 2023-07-12 14:37:20,237 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:37:20,238 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:37:20,268 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 14:37:20,268 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:37:20,270 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:37:20,270 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 14:37:20,275 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 14:37:20,275 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 14:37:20,276 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@757ba177 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 14:37:20,276 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 14:37:20,276 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 14:37:20,278 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:37:20,327 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:37:20,327 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@59ad5f70, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:20,327 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 14:37:20,373 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 14:37:20,434 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:20,435 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:20,435 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:20,436 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,360 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-4854218321173750501.jar 2023-07-12 14:37:21,361 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,361 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,446 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-9202567071834052019.jar 2023-07-12 14:37:21,447 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,447 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,448 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,449 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,449 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,450 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:21,450 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:37:21,451 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:37:21,452 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:37:21,452 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:37:21,453 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:37:21,454 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:37:21,455 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:37:21,456 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:37:21,456 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:37:21,457 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:37:21,458 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:21,458 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:21,459 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:21,459 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:21,460 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:21,461 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:21,461 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:22,037 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:37:22,040 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 14:37:22,043 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 14:37:24,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:37:24,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:37:24,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0003_000001 (auth:SIMPLE) 2023-07-12 14:37:25,542 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0004_000001 (auth:SIMPLE) 2023-07-12 14:37:32,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0004_000001 (auth:SIMPLE) 2023-07-12 14:37:34,795 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0004_000001 (auth:SIMPLE) 2023-07-12 14:37:38,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0004_000001 (auth:SIMPLE) 2023-07-12 14:37:39,341 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:37:39,341 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:37:39,345 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 14:37:39,346 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:37:39,346 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:37:39,346 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 14:37:39,349 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 14:37:39,349 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 14:37:39,349 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@757ba177 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 14:37:39,349 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 14:37:39,349 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/local-export-1689172625484/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 14:37:39,363 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 14:37:39,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-07-12 14:37:39,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 14:37:39,370 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172659370"}]},"ts":"1689172659370"} 2023-07-12 14:37:39,374 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 14:37:39,375 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 14:37:39,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, UNASSIGN}] 2023-07-12 14:37:39,379 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, UNASSIGN 2023-07-12 14:37:39,379 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, UNASSIGN 2023-07-12 14:37:39,381 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=74ee7edab995b2288e248557db77fbcd, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:39,381 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3e580bd130fa74bb292692585ad343c7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:39,382 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172659381"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172659381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172659381"}]},"ts":"1689172659381"} 2023-07-12 14:37:39,382 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172659381"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172659381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172659381"}]},"ts":"1689172659381"} 2023-07-12 14:37:39,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 74ee7edab995b2288e248557db77fbcd, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:37:39,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 3e580bd130fa74bb292692585ad343c7, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:37:39,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 14:37:39,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 74ee7edab995b2288e248557db77fbcd, disabling compactions & flushes 2023-07-12 14:37:39,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. after waiting 0 ms 2023-07-12 14:37:39,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:39,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:39,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3e580bd130fa74bb292692585ad343c7, disabling compactions & flushes 2023-07-12 14:37:39,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:39,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:39,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. after waiting 0 ms 2023-07-12 14:37:39,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:39,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:37:39,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:37:39,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd. 2023-07-12 14:37:39,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 74ee7edab995b2288e248557db77fbcd: 2023-07-12 14:37:39,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:37:39,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:37:39,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7. 2023-07-12 14:37:39,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3e580bd130fa74bb292692585ad343c7: 2023-07-12 14:37:39,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:39,601 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=74ee7edab995b2288e248557db77fbcd, regionState=CLOSED 2023-07-12 14:37:39,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172659601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172659601"}]},"ts":"1689172659601"} 2023-07-12 14:37:39,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:39,604 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3e580bd130fa74bb292692585ad343c7, regionState=CLOSED 2023-07-12 14:37:39,604 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689172659604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172659604"}]},"ts":"1689172659604"} 2023-07-12 14:37:39,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-12 14:37:39,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 74ee7edab995b2288e248557db77fbcd, server=jenkins-hbase17.apache.org,36691,1689172568228 in 218 msec 2023-07-12 14:37:39,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-12 14:37:39,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 3e580bd130fa74bb292692585ad343c7, server=jenkins-hbase17.apache.org,35263,1689172568285 in 219 msec 2023-07-12 14:37:39,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=74ee7edab995b2288e248557db77fbcd, UNASSIGN in 236 msec 2023-07-12 14:37:39,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 14:37:39,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3e580bd130fa74bb292692585ad343c7, UNASSIGN in 237 msec 2023-07-12 14:37:39,620 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172659620"}]},"ts":"1689172659620"} 2023-07-12 14:37:39,622 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 14:37:39,625 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 14:37:39,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 265 msec 2023-07-12 14:37:39,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 14:37:39,673 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 14:37:39,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-07-12 14:37:39,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,678 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 14:37:39,683 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,686 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 14:37:39,688 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,688 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,688 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,688 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 14:37:39,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 14:37:39,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 14:37:39,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 14:37:39,689 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,689 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:39,689 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,689 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:39,689 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,690 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:39,689 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 14:37:39,690 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:39,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 14:37:39,691 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:39,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:39,694 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/recovered.edits] 2023-07-12 14:37:39,694 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/recovered.edits] 2023-07-12 14:37:39,701 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf/a9983a46f47541c785c57b2cb9275cae to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/cf/a9983a46f47541c785c57b2cb9275cae 2023-07-12 14:37:39,701 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf/2a032af16a624e71bae7c960ac0124b0 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/cf/2a032af16a624e71bae7c960ac0124b0 2023-07-12 14:37:39,704 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7/recovered.edits/9.seqid 2023-07-12 14:37:39,704 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd/recovered.edits/9.seqid 2023-07-12 14:37:39,704 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/3e580bd130fa74bb292692585ad343c7 2023-07-12 14:37:39,704 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testConsecutiveExports/74ee7edab995b2288e248557db77fbcd 2023-07-12 14:37:39,704 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 14:37:39,705 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 14:37:39,706 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 14:37:39,712 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071284b3bf39a12248ac9a4048b29663e161 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071284b3bf39a12248ac9a4048b29663e161 2023-07-12 14:37:39,714 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307121c2c33dd47494dea9b208f641388b067 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307121c2c33dd47494dea9b208f641388b067 2023-07-12 14:37:39,714 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 14:37:39,717 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,721 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 14:37:39,723 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 14:37:39,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 14:37:39,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172659725"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:39,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172659725"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:39,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 14:37:39,728 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 74ee7edab995b2288e248557db77fbcd, NAME => 'testtb-testConsecutiveExports,,1689172623956.74ee7edab995b2288e248557db77fbcd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3e580bd130fa74bb292692585ad343c7, NAME => 'testtb-testConsecutiveExports,1,1689172623956.3e580bd130fa74bb292692585ad343c7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 14:37:39,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 14:37:39,728 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172659728"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:39,730 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 14:37:39,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 14:37:39,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 58 msec 2023-07-12 14:37:39,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 14:37:39,792 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 14:37:39,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 14:37:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 14:37:39,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 14:37:39,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 14:37:39,839 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 758), OpenFileDescriptor=890 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=607 (was 606) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=315 (was 1439) 2023-07-12 14:37:39,839 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-12 14:37:39,863 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=890, MaxFileDescriptor=60000, SystemLoadAverage=607, ProcessCount=185, AvailableMemoryMB=314 2023-07-12 14:37:39,863 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-12 14:37:39,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 14:37:39,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:39,870 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:37:39,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 14:37:39,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 14:37:39,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:37:39,876 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:39,876 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:39,876 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 empty. 2023-07-12 14:37:39,876 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 empty. 2023-07-12 14:37:39,877 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:39,877 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:39,877 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 14:37:39,887 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 14:37:39,888 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 614a435bc7edb19be92b4e818112bef7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:37:39,889 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d28cb37e33a1e06a2ecbd0f6728c979, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:37:39,920 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:39,920 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0d28cb37e33a1e06a2ecbd0f6728c979, disabling compactions & flushes 2023-07-12 14:37:39,920 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:39,920 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:39,920 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. after waiting 0 ms 2023-07-12 14:37:39,920 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:39,920 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:39,920 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0d28cb37e33a1e06a2ecbd0f6728c979: 2023-07-12 14:37:39,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:39,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 614a435bc7edb19be92b4e818112bef7, disabling compactions & flushes 2023-07-12 14:37:39,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:39,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:39,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. after waiting 0 ms 2023-07-12 14:37:39,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:39,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:39,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 614a435bc7edb19be92b4e818112bef7: 2023-07-12 14:37:39,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:37:39,925 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172659925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172659925"}]},"ts":"1689172659925"} 2023-07-12 14:37:39,926 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172659925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172659925"}]},"ts":"1689172659925"} 2023-07-12 14:37:39,935 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:37:39,937 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:37:39,937 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172659937"}]},"ts":"1689172659937"} 2023-07-12 14:37:39,939 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 14:37:39,941 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:37:39,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:37:39,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:37:39,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:37:39,942 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:37:39,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, ASSIGN}] 2023-07-12 14:37:39,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, ASSIGN 2023-07-12 14:37:39,945 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, ASSIGN 2023-07-12 14:37:39,958 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35687,1689172568342; forceNewPlan=false, retain=false 2023-07-12 14:37:39,958 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:37:39,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 14:37:40,109 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:37:40,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=614a435bc7edb19be92b4e818112bef7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,112 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0d28cb37e33a1e06a2ecbd0f6728c979, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172660112"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172660112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172660112"}]},"ts":"1689172660112"} 2023-07-12 14:37:40,112 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172660112"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172660112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172660112"}]},"ts":"1689172660112"} 2023-07-12 14:37:40,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 614a435bc7edb19be92b4e818112bef7, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:37:40,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 0d28cb37e33a1e06a2ecbd0f6728c979, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:37:40,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 14:37:40,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:40,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 614a435bc7edb19be92b4e818112bef7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 14:37:40,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. service=AccessControlService 2023-07-12 14:37:40,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:40,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:40,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,286 INFO [StoreOpener-614a435bc7edb19be92b4e818112bef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:40,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d28cb37e33a1e06a2ecbd0f6728c979, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 14:37:40,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. service=AccessControlService 2023-07-12 14:37:40,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:40,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:40,288 DEBUG [StoreOpener-614a435bc7edb19be92b4e818112bef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf 2023-07-12 14:37:40,288 DEBUG [StoreOpener-614a435bc7edb19be92b4e818112bef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf 2023-07-12 14:37:40,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,289 INFO [StoreOpener-614a435bc7edb19be92b4e818112bef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 614a435bc7edb19be92b4e818112bef7 columnFamilyName cf 2023-07-12 14:37:40,290 INFO [StoreOpener-0d28cb37e33a1e06a2ecbd0f6728c979-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,290 INFO [StoreOpener-614a435bc7edb19be92b4e818112bef7-1] regionserver.HStore(310): Store=614a435bc7edb19be92b4e818112bef7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:40,291 DEBUG [StoreOpener-0d28cb37e33a1e06a2ecbd0f6728c979-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf 2023-07-12 14:37:40,291 DEBUG [StoreOpener-0d28cb37e33a1e06a2ecbd0f6728c979-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf 2023-07-12 14:37:40,291 INFO [StoreOpener-0d28cb37e33a1e06a2ecbd0f6728c979-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d28cb37e33a1e06a2ecbd0f6728c979 columnFamilyName cf 2023-07-12 14:37:40,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,292 INFO [StoreOpener-0d28cb37e33a1e06a2ecbd0f6728c979-1] regionserver.HStore(310): Store=0d28cb37e33a1e06a2ecbd0f6728c979/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:40,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:37:40,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:37:40,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 614a435bc7edb19be92b4e818112bef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72813958, jitterRate=0.0850125253200531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:40,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 614a435bc7edb19be92b4e818112bef7: 2023-07-12 14:37:40,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7., pid=60, masterSystemTime=1689172660271 2023-07-12 14:37:40,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:40,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:40,307 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=614a435bc7edb19be92b4e818112bef7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,307 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172660307"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172660307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172660307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172660307"}]},"ts":"1689172660307"} 2023-07-12 14:37:40,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:37:40,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:37:40,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0d28cb37e33a1e06a2ecbd0f6728c979; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65491982, jitterRate=-0.024093419313430786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:40,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0d28cb37e33a1e06a2ecbd0f6728c979: 2023-07-12 14:37:40,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979., pid=61, masterSystemTime=1689172660271 2023-07-12 14:37:40,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:40,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:40,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-12 14:37:40,322 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0d28cb37e33a1e06a2ecbd0f6728c979, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 614a435bc7edb19be92b4e818112bef7, server=jenkins-hbase17.apache.org,36691,1689172568228 in 204 msec 2023-07-12 14:37:40,322 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172660322"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172660322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172660322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172660322"}]},"ts":"1689172660322"} 2023-07-12 14:37:40,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, ASSIGN in 379 msec 2023-07-12 14:37:40,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-12 14:37:40,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 0d28cb37e33a1e06a2ecbd0f6728c979, server=jenkins-hbase17.apache.org,35687,1689172568342 in 208 msec 2023-07-12 14:37:40,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-12 14:37:40,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, ASSIGN in 388 msec 2023-07-12 14:37:40,339 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:37:40,339 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172660339"}]},"ts":"1689172660339"} 2023-07-12 14:37:40,342 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 14:37:40,346 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:37:40,346 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 14:37:40,349 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 14:37:40,351 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:40,351 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:40,351 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:40,351 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:40,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:40,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:40,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:40,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:40,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 487 msec 2023-07-12 14:37:40,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 14:37:40,476 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 14:37:40,479 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,479 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:40,480 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:37:40,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 14:37:40,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172660497 (current time:1689172660497). 2023-07-12 14:37:40,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:37:40,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x7896f945 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:40,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21155965, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:40,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:40,509 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:40,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7896f945 to 127.0.0.1:61257 2023-07-12 14:37:40,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:40,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x3346419e to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:40,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cd5da62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:40,520 DEBUG [hconnection-0x77007aec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:40,523 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:40,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3346419e to 127.0.0.1:61257 2023-07-12 14:37:40,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:40,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 14:37:40,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:37:40,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 14:37:40,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 14:37:40,534 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 14:37:40,535 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689173260535 2023-07-12 14:37:40,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 14:37:40,538 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:37:40,538 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:37:40,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 14:37:40,540 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 14:37:40,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-12 14:37:40,544 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 14:37:40,545 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689173260545 2023-07-12 14:37:40,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,568 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 14:37:40,568 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:40,569 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 14:37:40,569 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 14:37:40,572 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,572 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,573 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:40,573 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:40,573 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:40,573 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:40,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:40,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,574 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,574 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,575 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,575 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:40,575 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 14:37:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 14:37:40,577 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 14:37:40,577 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 14:37:40,577 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 14:37:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,577 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:40,577 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,579 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 14:37:40,579 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:37:40,579 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 14:37:40,579 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 14:37:40,579 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 14:37:40,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,580 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 14:37:40,580 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:40,581 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 14:37:40,581 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 14:37:40,581 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 14:37:40,582 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,582 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:40,584 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,584 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:40,585 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e021b5[Count = 1] remaining members to acquire global barrier 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:40,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 14:37:40,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e021b5[Count = 0] remaining members to acquire global barrier 2023-07-12 14:37:40,591 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 14:37:40,591 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,593 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 14:37:40,593 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,593 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 14:37:40,593 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 14:37:40,593 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:37:40,593 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 14:37:40,593 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,593 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:37:40,596 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 14:37:40,596 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:40,596 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 14:37:40,596 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:40,598 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:40,598 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:40,598 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. started... 2023-07-12 14:37:40,598 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:40,598 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:40,598 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:40,598 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. started... 2023-07-12 14:37:40,599 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d28cb37e33a1e06a2ecbd0f6728c979: 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 614a435bc7edb19be92b4e818112bef7: 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:40,600 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:37:40,630 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. completed. 2023-07-12 14:37:40,630 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:40,630 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:40,630 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:40,630 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,630 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 14:37:40,630 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:37:40,631 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,631 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 14:37:40,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:40,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:40,631 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:40,631 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 14:37:40,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:40,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:40,636 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. completed. 2023-07-12 14:37:40,636 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:40,636 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:40,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,636 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:40,636 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,636 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 14:37:40,636 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:37:40,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,638 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:40,638 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,638 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 14:37:40,638 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:40,638 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 14:37:40,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:40,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 14:37:40,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:37:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,639 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:37:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:37:40,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 14:37:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:40,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:37:40,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 14:37:40,655 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 14:37:40,655 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:37:40,655 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:37:40,655 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,656 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:37:40,657 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,657 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:40,657 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,657 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:40,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:40,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:40,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:40,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,661 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,662 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:40,662 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:40,665 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,665 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,666 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,668 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,668 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:40,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:40,668 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:40,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:40,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,670 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:40,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,670 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:40,670 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:40,670 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,670 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:37:40,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 14:37:40,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,839 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:40,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 14:37:40,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:37:40,841 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 14:37:40,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 14:37:40,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,874 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:40,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689172660535Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689172660728 (+193 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689172660728Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689172660728Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689172660734 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689172660764 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689172660873 (+109 ms) 2023-07-12 14:37:40,877 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 14:37:40,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 340 msec 2023-07-12 14:37:41,006 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 14:37:41,141 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:41,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 14:37:41,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:37:41,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36691] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:37:41,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35687] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:37:41,152 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,152 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:41,152 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:37:41,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 14:37:41,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172661164 (current time:1689172661164). 2023-07-12 14:37:41,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:37:41,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x40129d8c to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:41,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5422503d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:41,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:41,309 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:41,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40129d8c to 127.0.0.1:61257 2023-07-12 14:37:41,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:41,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x2001eefa to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@742be98b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:41,628 DEBUG [hconnection-0x32ceec8b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:41,635 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:41,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2001eefa to 127.0.0.1:61257 2023-07-12 14:37:41,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:41,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 14:37:41,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:37:41,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 14:37:41,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 14:37:41,648 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 14:37:41,649 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689173261649 2023-07-12 14:37:41,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 14:37:41,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,650 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:37:41,650 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:37:41,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 14:37:41,658 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 14:37:41,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 13 msec 2023-07-12 14:37:41,661 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 14:37:41,662 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689173261662 2023-07-12 14:37:41,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,680 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 14:37:41,680 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:41,687 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 14:37:41,687 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 14:37:41,746 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,746 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,747 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:41,747 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:41,747 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:41,747 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:41,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:41,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:41,748 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,748 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,749 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,749 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:37:41,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 14:37:41,750 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:41,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 14:37:41,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 14:37:41,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,751 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 14:37:41,751 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 14:37:41,751 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:41,751 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 14:37:41,754 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 14:37:41,754 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 14:37:41,751 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:41,754 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 14:37:41,754 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:41,755 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 14:37:41,757 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 14:37:41,757 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 14:37:41,757 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 14:37:41,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 14:37:41,757 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 14:37:41,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:37:41,757 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 14:37:41,757 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:37:41,758 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,758 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,758 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:41,760 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,760 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:41,761 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,761 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:41,761 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:41,761 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,761 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,761 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f340ade[Count = 1] remaining members to acquire global barrier 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:41,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 14:37:41,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f340ade[Count = 0] remaining members to acquire global barrier 2023-07-12 14:37:41,766 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 14:37:41,766 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,766 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,766 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,766 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,766 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 14:37:41,767 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,767 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,767 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:37:41,767 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 14:37:41,767 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 14:37:41,767 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:37:41,767 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 14:37:41,768 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 14:37:41,768 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:41,768 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 14:37:41,770 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:41,771 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:41,771 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:41,771 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:41,771 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:41,771 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:41,771 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. started... 2023-07-12 14:37:41,771 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. started... 2023-07-12 14:37:41,771 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 614a435bc7edb19be92b4e818112bef7 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 14:37:41,771 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d28cb37e33a1e06a2ecbd0f6728c979 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 14:37:41,810 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712a1ecfaf9f5c4441c9286ea0001966d3b to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ecfaf9f5c4441c9286ea0001966d3b 2023-07-12 14:37:41,815 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712d914bc48410a4190ba9d55bf3849b526 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712d914bc48410a4190ba9d55bf3849b526 2023-07-12 14:37:41,817 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/.tmp/cf/49ccf5e6b3764e038eda57d36ffc2921 2023-07-12 14:37:41,823 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/.tmp/cf/c53e84922abe439a8a5b9644189a840a 2023-07-12 14:37:41,823 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/.tmp/cf/49ccf5e6b3764e038eda57d36ffc2921 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf/49ccf5e6b3764e038eda57d36ffc2921 2023-07-12 14:37:41,827 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf/49ccf5e6b3764e038eda57d36ffc2921, entries=2, sequenceid=6, filesize=5.3 K 2023-07-12 14:37:41,828 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 614a435bc7edb19be92b4e818112bef7 in 57ms, sequenceid=6, compaction requested=false 2023-07-12 14:37:41,830 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 614a435bc7edb19be92b4e818112bef7: 2023-07-12 14:37:41,830 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,830 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:41,830 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf/49ccf5e6b3764e038eda57d36ffc2921] hfiles 2023-07-12 14:37:41,830 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf/49ccf5e6b3764e038eda57d36ffc2921 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,830 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/.tmp/cf/c53e84922abe439a8a5b9644189a840a as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf/c53e84922abe439a8a5b9644189a840a 2023-07-12 14:37:41,835 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf/c53e84922abe439a8a5b9644189a840a, entries=48, sequenceid=6, filesize=13.7 K 2023-07-12 14:37:41,836 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0d28cb37e33a1e06a2ecbd0f6728c979 in 65ms, sequenceid=6, compaction requested=false 2023-07-12 14:37:41,836 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d28cb37e33a1e06a2ecbd0f6728c979: 2023-07-12 14:37:41,836 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,836 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:41,836 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf/c53e84922abe439a8a5b9644189a840a] hfiles 2023-07-12 14:37:41,836 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf/c53e84922abe439a8a5b9644189a840a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,844 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. completed. 2023-07-12 14:37:41,845 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:37:41,845 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:41,845 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:41,845 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,845 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 14:37:41,845 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:37:41,846 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 14:37:41,846 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,846 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:41,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:41,846 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 14:37:41,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:41,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:41,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,849 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. completed. 2023-07-12 14:37:41,849 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:37:41,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,849 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:41,849 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:41,849 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,849 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 14:37:41,849 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:37:41,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:41,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,854 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 14:37:41,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,854 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:41,854 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,854 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 14:37:41,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:41,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:41,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:37:41,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 14:37:41,859 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 14:37:41,859 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:37:41,859 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:37:41,859 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,859 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:37:41,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:41,861 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:41,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:41,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:41,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:41,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:41,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:41,861 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:41,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,862 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:41,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,864 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:41,864 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,864 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:41,867 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:41,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:41,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:41,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:41,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:41,869 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:41,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:37:41,869 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:41,869 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,869 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:41,869 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:41,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:41,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:41,870 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:41,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:41,870 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:41,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712d914bc48410a4190ba9d55bf3849b526, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ecfaf9f5c4441c9286ea0001966d3b] mob files 2023-07-12 14:37:41,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712d914bc48410a4190ba9d55bf3849b526 2023-07-12 14:37:41,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ecfaf9f5c4441c9286ea0001966d3b 2023-07-12 14:37:41,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 14:37:41,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,946 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:37:41,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689172661649Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689172661877 (+228 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689172661877Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689172661877Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689172661882 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689172661896 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689172661946 (+50 ms) 2023-07-12 14:37:41,950 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 14:37:41,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 295 msec 2023-07-12 14:37:41,958 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:41,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 14:37:41,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:37:42,006 DEBUG [Listener at jenkins-hbase17.apache.org/34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 14:37:42,011 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 14:37:42,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35263] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 14:37:42,014 DEBUG [Listener at jenkins-hbase17.apache.org/34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 14:37:42,021 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 14:37:42,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35687] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 14:37:42,023 DEBUG [Listener at jenkins-hbase17.apache.org/34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 14:37:42,029 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 14:37:42,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36691] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 14:37:42,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 14:37:42,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:42,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:37:42,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 14:37:42,036 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:37:42,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 14:37:42,044 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,044 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,045 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede empty. 2023-07-12 14:37:42,045 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 empty. 2023-07-12 14:37:42,045 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,045 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,045 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 14:37:42,060 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 14:37:42,061 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a22ed6ff5e7fb1424f9c96b3871277f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:37:42,061 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 15e01523e63033d3159264e80fafdede, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:37:42,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:42,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a22ed6ff5e7fb1424f9c96b3871277f4, disabling compactions & flushes 2023-07-12 14:37:42,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. after waiting 0 ms 2023-07-12 14:37:42,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a22ed6ff5e7fb1424f9c96b3871277f4: 2023-07-12 14:37:42,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:42,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 15e01523e63033d3159264e80fafdede, disabling compactions & flushes 2023-07-12 14:37:42,085 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. after waiting 0 ms 2023-07-12 14:37:42,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,085 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 15e01523e63033d3159264e80fafdede: 2023-07-12 14:37:42,087 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:37:42,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172662088"}]},"ts":"1689172662088"} 2023-07-12 14:37:42,089 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172662088"}]},"ts":"1689172662088"} 2023-07-12 14:37:42,091 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:37:42,091 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:37:42,092 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172662091"}]},"ts":"1689172662091"} 2023-07-12 14:37:42,093 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 14:37:42,096 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:37:42,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:37:42,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:37:42,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:37:42,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:37:42,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, ASSIGN}] 2023-07-12 14:37:42,100 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, ASSIGN 2023-07-12 14:37:42,100 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, ASSIGN 2023-07-12 14:37:42,100 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35263,1689172568285; forceNewPlan=false, retain=false 2023-07-12 14:37:42,100 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35687,1689172568342; forceNewPlan=false, retain=false 2023-07-12 14:37:42,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 14:37:42,251 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:37:42,253 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a22ed6ff5e7fb1424f9c96b3871277f4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:42,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=15e01523e63033d3159264e80fafdede, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:42,253 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662253"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172662253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172662253"}]},"ts":"1689172662253"} 2023-07-12 14:37:42,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662253"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172662253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172662253"}]},"ts":"1689172662253"} 2023-07-12 14:37:42,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure a22ed6ff5e7fb1424f9c96b3871277f4, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:37:42,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 15e01523e63033d3159264e80fafdede, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:37:42,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 14:37:42,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15e01523e63033d3159264e80fafdede, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 14:37:42,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. service=AccessControlService 2023-07-12 14:37:42,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a22ed6ff5e7fb1424f9c96b3871277f4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 14:37:42,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. service=AccessControlService 2023-07-12 14:37:42,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:42,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:42,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:42,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:42,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,416 INFO [StoreOpener-a22ed6ff5e7fb1424f9c96b3871277f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,416 INFO [StoreOpener-15e01523e63033d3159264e80fafdede-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,418 DEBUG [StoreOpener-15e01523e63033d3159264e80fafdede-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf 2023-07-12 14:37:42,418 DEBUG [StoreOpener-15e01523e63033d3159264e80fafdede-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf 2023-07-12 14:37:42,418 DEBUG [StoreOpener-a22ed6ff5e7fb1424f9c96b3871277f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf 2023-07-12 14:37:42,418 DEBUG [StoreOpener-a22ed6ff5e7fb1424f9c96b3871277f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf 2023-07-12 14:37:42,418 INFO [StoreOpener-15e01523e63033d3159264e80fafdede-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15e01523e63033d3159264e80fafdede columnFamilyName cf 2023-07-12 14:37:42,419 INFO [StoreOpener-a22ed6ff5e7fb1424f9c96b3871277f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a22ed6ff5e7fb1424f9c96b3871277f4 columnFamilyName cf 2023-07-12 14:37:42,419 INFO [StoreOpener-15e01523e63033d3159264e80fafdede-1] regionserver.HStore(310): Store=15e01523e63033d3159264e80fafdede/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:42,419 INFO [StoreOpener-a22ed6ff5e7fb1424f9c96b3871277f4-1] regionserver.HStore(310): Store=a22ed6ff5e7fb1424f9c96b3871277f4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:42,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:37:42,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:37:42,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 15e01523e63033d3159264e80fafdede; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74289094, jitterRate=0.10699376463890076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:42,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a22ed6ff5e7fb1424f9c96b3871277f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71192213, jitterRate=0.06084664165973663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:42,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 15e01523e63033d3159264e80fafdede: 2023-07-12 14:37:42,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a22ed6ff5e7fb1424f9c96b3871277f4: 2023-07-12 14:37:42,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede., pid=70, masterSystemTime=1689172662407 2023-07-12 14:37:42,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4., pid=69, masterSystemTime=1689172662407 2023-07-12 14:37:42,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=15e01523e63033d3159264e80fafdede, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:42,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662430"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172662430"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172662430"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172662430"}]},"ts":"1689172662430"} 2023-07-12 14:37:42,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a22ed6ff5e7fb1424f9c96b3871277f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:42,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662432"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172662432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172662432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172662432"}]},"ts":"1689172662432"} 2023-07-12 14:37:42,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 14:37:42,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 15e01523e63033d3159264e80fafdede, server=jenkins-hbase17.apache.org,35687,1689172568342 in 176 msec 2023-07-12 14:37:42,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 14:37:42,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure a22ed6ff5e7fb1424f9c96b3871277f4, server=jenkins-hbase17.apache.org,35263,1689172568285 in 179 msec 2023-07-12 14:37:42,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, ASSIGN in 338 msec 2023-07-12 14:37:42,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 14:37:42,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, ASSIGN in 339 msec 2023-07-12 14:37:42,439 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:37:42,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172662439"}]},"ts":"1689172662439"} 2023-07-12 14:37:42,441 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 14:37:42,444 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:37:42,445 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 14:37:42,449 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 14:37:42,450 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:42,450 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:42,450 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:42,450 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:37:42,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 421 msec 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 14:37:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 14:37:42,642 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 14:37:42,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions a22ed6ff5e7fb1424f9c96b3871277f4, 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a22ed6ff5e7fb1424f9c96b3871277f4, 15e01523e63033d3159264e80fafdede], force=true 2023-07-12 14:37:42,681 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a22ed6ff5e7fb1424f9c96b3871277f4, 15e01523e63033d3159264e80fafdede], force=true 2023-07-12 14:37:42,681 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a22ed6ff5e7fb1424f9c96b3871277f4, 15e01523e63033d3159264e80fafdede], force=true 2023-07-12 14:37:42,681 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a22ed6ff5e7fb1424f9c96b3871277f4, 15e01523e63033d3159264e80fafdede], force=true 2023-07-12 14:37:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 14:37:42,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, UNASSIGN}] 2023-07-12 14:37:42,716 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, UNASSIGN 2023-07-12 14:37:42,716 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, UNASSIGN 2023-07-12 14:37:42,717 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=15e01523e63033d3159264e80fafdede, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:42,717 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a22ed6ff5e7fb1424f9c96b3871277f4, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:42,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662717"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172662717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172662717"}]},"ts":"1689172662717"} 2023-07-12 14:37:42,718 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662717"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172662717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172662717"}]},"ts":"1689172662717"} 2023-07-12 14:37:42,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 15e01523e63033d3159264e80fafdede, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:37:42,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a22ed6ff5e7fb1424f9c96b3871277f4, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:37:42,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 14:37:42,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 15e01523e63033d3159264e80fafdede, disabling compactions & flushes 2023-07-12 14:37:42,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a22ed6ff5e7fb1424f9c96b3871277f4, disabling compactions & flushes 2023-07-12 14:37:42,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. after waiting 0 ms 2023-07-12 14:37:42,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. after waiting 0 ms 2023-07-12 14:37:42,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing a22ed6ff5e7fb1424f9c96b3871277f4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 14:37:42,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 15e01523e63033d3159264e80fafdede 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 14:37:42,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/.tmp/cf/b976a9d05d2f4558a76cadce9050c220 2023-07-12 14:37:42,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/.tmp/cf/9774544608ff4e55b7f5be92f570eeaf 2023-07-12 14:37:42,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/.tmp/cf/b976a9d05d2f4558a76cadce9050c220 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf/b976a9d05d2f4558a76cadce9050c220 2023-07-12 14:37:42,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/.tmp/cf/9774544608ff4e55b7f5be92f570eeaf as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf/9774544608ff4e55b7f5be92f570eeaf 2023-07-12 14:37:42,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf/b976a9d05d2f4558a76cadce9050c220, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 14:37:42,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 15e01523e63033d3159264e80fafdede in 29ms, sequenceid=5, compaction requested=false 2023-07-12 14:37:42,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 14:37:42,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf/9774544608ff4e55b7f5be92f570eeaf, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 14:37:42,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a22ed6ff5e7fb1424f9c96b3871277f4 in 31ms, sequenceid=5, compaction requested=false 2023-07-12 14:37:42,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 14:37:42,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:37:42,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede. 2023-07-12 14:37:42,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 15e01523e63033d3159264e80fafdede: 2023-07-12 14:37:42,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 15e01523e63033d3159264e80fafdede 2023-07-12 14:37:42,931 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=15e01523e63033d3159264e80fafdede, regionState=CLOSED 2023-07-12 14:37:42,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172662931"}]},"ts":"1689172662931"} 2023-07-12 14:37:42,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-12 14:37:42,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 15e01523e63033d3159264e80fafdede, server=jenkins-hbase17.apache.org,35687,1689172568342 in 212 msec 2023-07-12 14:37:42,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=15e01523e63033d3159264e80fafdede, UNASSIGN in 222 msec 2023-07-12 14:37:42,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 14:37:42,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:37:42,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4. 2023-07-12 14:37:42,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a22ed6ff5e7fb1424f9c96b3871277f4: 2023-07-12 14:37:42,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:37:42,939 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a22ed6ff5e7fb1424f9c96b3871277f4, regionState=CLOSED 2023-07-12 14:37:42,939 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689172662939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172662939"}]},"ts":"1689172662939"} 2023-07-12 14:37:42,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-12 14:37:42,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a22ed6ff5e7fb1424f9c96b3871277f4, server=jenkins-hbase17.apache.org,35263,1689172568285 in 219 msec 2023-07-12 14:37:42,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 14:37:42,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a22ed6ff5e7fb1424f9c96b3871277f4, UNASSIGN in 236 msec 2023-07-12 14:37:42,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 14:37:43,007 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 14:37:43,011 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662031.a22ed6ff5e7fb1424f9c96b3871277f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:43,011 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689172662031.15e01523e63033d3159264e80fafdede.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:43,011 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 14:37:43,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, ASSIGN}] 2023-07-12 14:37:43,059 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, ASSIGN 2023-07-12 14:37:43,060 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,35263,1689172568285; forceNewPlan=false, retain=false 2023-07-12 14:37:43,210 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 14:37:43,212 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8f968c185682d6787cce8ecba6ddf2b7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,212 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689172663212"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172663212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172663212"}]},"ts":"1689172663212"} 2023-07-12 14:37:43,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 8f968c185682d6787cce8ecba6ddf2b7, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:37:43,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 14:37:43,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:37:43,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f968c185682d6787cce8ecba6ddf2b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.', STARTKEY => '', ENDKEY => ''} 2023-07-12 14:37:43,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. service=AccessControlService 2023-07-12 14:37:43,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:37:43,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:37:43,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/.regioninfo 2023-07-12 14:37:43,383 INFO [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,383 DEBUG [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf 2023-07-12 14:37:43,384 DEBUG [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf 2023-07-12 14:37:43,384 INFO [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f968c185682d6787cce8ecba6ddf2b7 columnFamilyName cf 2023-07-12 14:37:43,417 DEBUG [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/9774544608ff4e55b7f5be92f570eeaf.a22ed6ff5e7fb1424f9c96b3871277f4->hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf/9774544608ff4e55b7f5be92f570eeaf-top 2023-07-12 14:37:43,425 DEBUG [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/b976a9d05d2f4558a76cadce9050c220.15e01523e63033d3159264e80fafdede->hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf/b976a9d05d2f4558a76cadce9050c220-top 2023-07-12 14:37:43,426 INFO [StoreOpener-8f968c185682d6787cce8ecba6ddf2b7-1] regionserver.HStore(310): Store=8f968c185682d6787cce8ecba6ddf2b7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:37:43,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:37:43,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8f968c185682d6787cce8ecba6ddf2b7; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67302129, jitterRate=0.0028798729181289673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:37:43,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8f968c185682d6787cce8ecba6ddf2b7: 2023-07-12 14:37:43,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7., pid=77, masterSystemTime=1689172663366 2023-07-12 14:37:43,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.,because compaction is disabled. 2023-07-12 14:37:43,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:37:43,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:37:43,446 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8f968c185682d6787cce8ecba6ddf2b7, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,446 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689172663446"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172663446"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172663446"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172663446"}]},"ts":"1689172663446"} 2023-07-12 14:37:43,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 14:37:43,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 8f968c185682d6787cce8ecba6ddf2b7, server=jenkins-hbase17.apache.org,35263,1689172568285 in 234 msec 2023-07-12 14:37:43,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 14:37:43,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, ASSIGN in 393 msec 2023-07-12 14:37:43,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a22ed6ff5e7fb1424f9c96b3871277f4, 15e01523e63033d3159264e80fafdede], force=true in 781 msec 2023-07-12 14:37:43,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 14:37:43,796 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 14:37:43,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 14:37:43,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172663796 (current time:1689172663796). 2023-07-12 14:37:43,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:37:43,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x5ca29875 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:43,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db15bc3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:43,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:43,806 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:43,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ca29875 to 127.0.0.1:61257 2023-07-12 14:37:43,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:43,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x72b0d5b4 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:37:43,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a199aa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:37:43,816 DEBUG [hconnection-0x6d21b164-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:37:43,819 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:37:43,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72b0d5b4 to 127.0.0.1:61257 2023-07-12 14:37:43,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:37:43,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 14:37:43,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:37:43,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 14:37:43,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 14:37:43,833 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 14:37:43,834 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689173263834 2023-07-12 14:37:43,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 14:37:43,840 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:37:43,840 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:37:43,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 14:37:43,842 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 14:37:43,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 14 msec 2023-07-12 14:37:43,846 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 14:37:43,846 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689173263846 2023-07-12 14:37:43,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,859 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 14:37:43,859 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:43,860 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 14:37:43,860 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 14:37:43,861 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,861 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,862 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:43,862 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:43,862 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:43,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:43,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:43,862 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:43,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:43,863 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 14:37:43,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 14:37:43,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,864 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 14:37:43,864 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 14:37:43,864 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:43,864 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:43,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,865 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 14:37:43,865 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 14:37:43,865 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:37:43,865 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 14:37:43,866 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 14:37:43,866 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 14:37:43,866 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 14:37:43,865 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 14:37:43,866 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 14:37:43,866 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 14:37:43,866 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 14:37:43,867 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,867 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,867 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,867 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:43,867 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,867 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:43,868 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,868 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:43,868 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,868 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:37:43,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:43,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 14:37:43,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b5ad5fe[Count = 0] remaining members to acquire global barrier 2023-07-12 14:37:43,870 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 14:37:43,870 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,870 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,870 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,871 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:37:43,870 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 14:37:43,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 14:37:43,871 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:37:43,872 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:37:43,872 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:37:43,872 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:37:43,872 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. started... 2023-07-12 14:37:43,872 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 14:37:43,872 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:43,872 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 14:37:43,873 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f968c185682d6787cce8ecba6ddf2b7: 2023-07-12 14:37:43,874 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 14:37:43,874 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,874 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:43,874 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:37:43,874 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 14:37:43,875 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/9774544608ff4e55b7f5be92f570eeaf.a22ed6ff5e7fb1424f9c96b3871277f4->hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf/9774544608ff4e55b7f5be92f570eeaf-top, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/b976a9d05d2f4558a76cadce9050c220.15e01523e63033d3159264e80fafdede->hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf/b976a9d05d2f4558a76cadce9050c220-top] hfiles 2023-07-12 14:37:43,875 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/9774544608ff4e55b7f5be92f570eeaf.a22ed6ff5e7fb1424f9c96b3871277f4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,876 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/b976a9d05d2f4558a76cadce9050c220.15e01523e63033d3159264e80fafdede for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,883 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. completed. 2023-07-12 14:37:43,883 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:37:43,883 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:37:43,883 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:37:43,883 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,883 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 14:37:43,883 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:37:43,888 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 14:37:43,888 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,888 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:43,888 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 14:37:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,35263,1689172568285': 2023-07-12 14:37:43,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 14:37:43,895 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 14:37:43,895 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:37:43,895 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:37:43,895 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,895 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:37:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:43,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,897 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,897 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:37:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,896 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:43,898 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,899 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,900 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:37:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,901 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:43,902 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:37:43,902 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:37:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:37:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:43,902 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,905 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,905 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:37:43,905 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:37:43,905 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,905 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:37:43,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:43,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:37:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:37:43,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-12 14:37:43,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,940 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:43,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 14:37:43,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:37:43,941 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:37:43,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 14:37:43,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,950 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:43,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689172663835Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689172663902 (+67 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689172663903 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689172663914 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689172663924 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689172663950 (+26 ms) 2023-07-12 14:37:43,953 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 14:37:43,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 114 msec 2023-07-12 14:37:44,127 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0004_000001 (auth:SIMPLE) 2023-07-12 14:37:44,141 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:37:44,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 14:37:44,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:37:44,143 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143 2023-07-12 14:37:44,143 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:36845, tgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143, rawTgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:37:44,165 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:37:44,165 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1155887811_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:44,165 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 14:37:44,181 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:37:44,224 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:44,224 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:44,225 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:44,225 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,196 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:37:45,225 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-569121039828606265.jar 2023-07-12 14:37:45,226 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,226 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,315 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-9076806815184172583.jar 2023-07-12 14:37:45,316 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,316 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,317 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,317 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,318 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,318 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:37:45,319 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:37:45,320 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:37:45,320 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:37:45,321 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:37:45,321 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:37:45,322 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:37:45,322 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:37:45,323 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:37:45,323 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:37:45,324 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:37:45,325 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:45,325 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:45,326 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:45,327 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:45,327 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:37:45,328 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:45,329 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:37:47,058 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:37:47,062 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 14:37:47,065 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 14:37:47,147 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:37:47,147 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:37:47,962 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0005_000001 (auth:SIMPLE) 2023-07-12 14:37:55,711 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0005_000001 (auth:SIMPLE) 2023-07-12 14:37:58,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0005_000001 (auth:SIMPLE) 2023-07-12 14:38:01,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0005_000001 (auth:SIMPLE) 2023-07-12 14:38:01,733 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689172578979_0005_01_000002 is : 143 2023-07-12 14:38:03,314 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:38:03,316 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:38:03,324 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:03,324 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:38:03,325 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:38:03,325 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:03,326 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 14:38:03,326 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 14:38:03,326 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:03,326 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 14:38:03,326 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172664143/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 14:38:03,336 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:03,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:03,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:03,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 14:38:03,341 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172683341"}]},"ts":"1689172683341"} 2023-07-12 14:38:03,343 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 14:38:03,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 14:38:03,614 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 14:38:03,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, UNASSIGN}] 2023-07-12 14:38:03,620 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, UNASSIGN 2023-07-12 14:38:03,622 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8f968c185682d6787cce8ecba6ddf2b7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:03,622 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689172683622"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172683622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172683622"}]},"ts":"1689172683622"} 2023-07-12 14:38:03,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 8f968c185682d6787cce8ecba6ddf2b7, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:38:03,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 14:38:03,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:38:03,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8f968c185682d6787cce8ecba6ddf2b7, disabling compactions & flushes 2023-07-12 14:38:03,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:38:03,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:38:03,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. after waiting 0 ms 2023-07-12 14:38:03,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:38:03,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 14:38:03,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:03,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7. 2023-07-12 14:38:03,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8f968c185682d6787cce8ecba6ddf2b7: 2023-07-12 14:38:03,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:38:03,839 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8f968c185682d6787cce8ecba6ddf2b7, regionState=CLOSED 2023-07-12 14:38:03,840 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689172683839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172683839"}]},"ts":"1689172683839"} 2023-07-12 14:38:03,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 14:38:03,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 8f968c185682d6787cce8ecba6ddf2b7, server=jenkins-hbase17.apache.org,35263,1689172568285 in 217 msec 2023-07-12 14:38:03,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 14:38:03,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8f968c185682d6787cce8ecba6ddf2b7, UNASSIGN in 228 msec 2023-07-12 14:38:03,847 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172683847"}]},"ts":"1689172683847"} 2023-07-12 14:38:03,849 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 14:38:03,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 14:38:03,998 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 14:38:04,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 666 msec 2023-07-12 14:38:04,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 14:38:04,447 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 14:38:04,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,454 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,456 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,456 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,457 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 14:38:04,463 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,463 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 14:38:04,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 14:38:04,465 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,465 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:04,465 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,465 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:04,466 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,466 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:04,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 14:38:04,466 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,466 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:04,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:04,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:04,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 14:38:04,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:04,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:04,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede 2023-07-12 14:38:04,472 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:38:04,473 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/recovered.edits] 2023-07-12 14:38:04,480 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:38:04,484 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/recovered.edits] 2023-07-12 14:38:04,485 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/recovered.edits] 2023-07-12 14:38:04,487 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf/b976a9d05d2f4558a76cadce9050c220 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/cf/b976a9d05d2f4558a76cadce9050c220 2023-07-12 14:38:04,499 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf/9774544608ff4e55b7f5be92f570eeaf to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/cf/9774544608ff4e55b7f5be92f570eeaf 2023-07-12 14:38:04,501 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/9774544608ff4e55b7f5be92f570eeaf.a22ed6ff5e7fb1424f9c96b3871277f4 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/9774544608ff4e55b7f5be92f570eeaf.a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:38:04,505 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/recovered.edits/8.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede/recovered.edits/8.seqid 2023-07-12 14:38:04,506 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/15e01523e63033d3159264e80fafdede 2023-07-12 14:38:04,506 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/b976a9d05d2f4558a76cadce9050c220.15e01523e63033d3159264e80fafdede to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/cf/b976a9d05d2f4558a76cadce9050c220.15e01523e63033d3159264e80fafdede 2023-07-12 14:38:04,508 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/recovered.edits/8.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4/recovered.edits/8.seqid 2023-07-12 14:38:04,508 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a22ed6ff5e7fb1424f9c96b3871277f4 2023-07-12 14:38:04,509 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/recovered.edits/12.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7/recovered.edits/12.seqid 2023-07-12 14:38:04,510 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8f968c185682d6787cce8ecba6ddf2b7 2023-07-12 14:38:04,510 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 14:38:04,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,527 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 14:38:04,540 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 14:38:04,542 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,542 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 14:38:04,542 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172684542"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:04,547 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 14:38:04,547 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8f968c185682d6787cce8ecba6ddf2b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689172662032.8f968c185682d6787cce8ecba6ddf2b7.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 14:38:04,547 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 14:38:04,547 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172684547"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:04,565 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 14:38:04,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 14:38:04,569 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:04,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 121 msec 2023-07-12 14:38:04,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 14:38:04,770 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 14:38:04,771 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:04,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:04,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:04,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 14:38:04,778 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172684778"}]},"ts":"1689172684778"} 2023-07-12 14:38:04,780 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 14:38:04,781 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 14:38:04,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, UNASSIGN}] 2023-07-12 14:38:04,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, UNASSIGN 2023-07-12 14:38:04,785 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, UNASSIGN 2023-07-12 14:38:04,786 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0d28cb37e33a1e06a2ecbd0f6728c979, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:04,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=614a435bc7edb19be92b4e818112bef7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:04,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172684786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172684786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172684786"}]},"ts":"1689172684786"} 2023-07-12 14:38:04,786 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172684786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172684786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172684786"}]},"ts":"1689172684786"} 2023-07-12 14:38:04,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 0d28cb37e33a1e06a2ecbd0f6728c979, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:38:04,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 614a435bc7edb19be92b4e818112bef7, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:38:04,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 14:38:04,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:38:04,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 614a435bc7edb19be92b4e818112bef7, disabling compactions & flushes 2023-07-12 14:38:04,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:38:04,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:38:04,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. after waiting 0 ms 2023-07-12 14:38:04,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:38:04,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:38:04,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0d28cb37e33a1e06a2ecbd0f6728c979, disabling compactions & flushes 2023-07-12 14:38:04,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:38:04,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:38:04,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. after waiting 0 ms 2023-07-12 14:38:04,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:38:05,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:38:05,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:38:05,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:05,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7. 2023-07-12 14:38:05,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 614a435bc7edb19be92b4e818112bef7: 2023-07-12 14:38:05,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:05,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979. 2023-07-12 14:38:05,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0d28cb37e33a1e06a2ecbd0f6728c979: 2023-07-12 14:38:05,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 614a435bc7edb19be92b4e818112bef7 2023-07-12 14:38:05,014 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=614a435bc7edb19be92b4e818112bef7, regionState=CLOSED 2023-07-12 14:38:05,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172685014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172685014"}]},"ts":"1689172685014"} 2023-07-12 14:38:05,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:38:05,016 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0d28cb37e33a1e06a2ecbd0f6728c979, regionState=CLOSED 2023-07-12 14:38:05,017 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689172685016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172685016"}]},"ts":"1689172685016"} 2023-07-12 14:38:05,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-12 14:38:05,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 614a435bc7edb19be92b4e818112bef7, server=jenkins-hbase17.apache.org,36691,1689172568228 in 225 msec 2023-07-12 14:38:05,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-12 14:38:05,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 0d28cb37e33a1e06a2ecbd0f6728c979, server=jenkins-hbase17.apache.org,35687,1689172568342 in 229 msec 2023-07-12 14:38:05,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=614a435bc7edb19be92b4e818112bef7, UNASSIGN in 238 msec 2023-07-12 14:38:05,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-12 14:38:05,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0d28cb37e33a1e06a2ecbd0f6728c979, UNASSIGN in 239 msec 2023-07-12 14:38:05,028 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172685028"}]},"ts":"1689172685028"} 2023-07-12 14:38:05,029 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 14:38:05,031 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 14:38:05,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 259 msec 2023-07-12 14:38:05,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 14:38:05,081 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 14:38:05,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,087 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,089 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,092 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,092 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,092 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,092 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 14:38:05,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 14:38:05,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 14:38:05,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 14:38:05,093 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,093 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,094 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,094 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,094 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,094 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,094 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,094 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,094 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 2023-07-12 14:38:05,094 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:38:05,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 14:38:05,097 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/recovered.edits] 2023-07-12 14:38:05,097 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/recovered.edits] 2023-07-12 14:38:05,104 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf/49ccf5e6b3764e038eda57d36ffc2921 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/cf/49ccf5e6b3764e038eda57d36ffc2921 2023-07-12 14:38:05,104 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf/c53e84922abe439a8a5b9644189a840a to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/cf/c53e84922abe439a8a5b9644189a840a 2023-07-12 14:38:05,107 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7/recovered.edits/9.seqid 2023-07-12 14:38:05,107 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979/recovered.edits/9.seqid 2023-07-12 14:38:05,108 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/614a435bc7edb19be92b4e818112bef7 2023-07-12 14:38:05,108 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0d28cb37e33a1e06a2ecbd0f6728c979 2023-07-12 14:38:05,108 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 14:38:05,108 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 14:38:05,110 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 14:38:05,114 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712d914bc48410a4190ba9d55bf3849b526 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712d914bc48410a4190ba9d55bf3849b526 2023-07-12 14:38:05,116 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ecfaf9f5c4441c9286ea0001966d3b to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712a1ecfaf9f5c4441c9286ea0001966d3b 2023-07-12 14:38:05,116 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 14:38:05,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,121 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 14:38:05,123 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 14:38:05,124 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,124 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 14:38:05,124 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172685124"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:05,124 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172685124"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:05,126 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 14:38:05,126 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 614a435bc7edb19be92b4e818112bef7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689172659865.614a435bc7edb19be92b4e818112bef7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0d28cb37e33a1e06a2ecbd0f6728c979, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689172659865.0d28cb37e33a1e06a2ecbd0f6728c979.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 14:38:05,126 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 14:38:05,126 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172685126"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:05,127 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 14:38:05,128 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 46 msec 2023-07-12 14:38:05,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 14:38:05,197 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 14:38:05,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 14:38:05,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 14:38:05,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 14:38:05,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 14:38:05,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 14:38:05,255 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=754 (was 744) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4228 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:38567 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:54090 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:44902 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:42010 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 890) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=645 (was 607) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=980 (was 314) - AvailableMemoryMB LEAK? - 2023-07-12 14:38:05,256 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-12 14:38:05,286 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=754, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=645, ProcessCount=185, AvailableMemoryMB=977 2023-07-12 14:38:05,286 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-12 14:38:05,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 14:38:05,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:05,292 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:38:05,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 14:38:05,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:38:05,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 14:38:05,296 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,296 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,296 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 empty. 2023-07-12 14:38:05,296 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e empty. 2023-07-12 14:38:05,297 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,297 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,297 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 14:38:05,338 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 14:38:05,340 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a33ad853bbdedc7585f303dde215960, NAME => 'testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:38:05,340 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 792591cd40e9be7ba9c8118fd977699e, NAME => 'testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:38:05,373 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8a33ad853bbdedc7585f303dde215960, disabling compactions & flushes 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 792591cd40e9be7ba9c8118fd977699e, disabling compactions & flushes 2023-07-12 14:38:05,374 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,374 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. after waiting 0 ms 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,374 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8a33ad853bbdedc7585f303dde215960: 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. after waiting 0 ms 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,374 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,374 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 792591cd40e9be7ba9c8118fd977699e: 2023-07-12 14:38:05,376 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:38:05,377 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172685377"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172685377"}]},"ts":"1689172685377"} 2023-07-12 14:38:05,377 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172685377"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172685377"}]},"ts":"1689172685377"} 2023-07-12 14:38:05,379 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:38:05,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:38:05,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172685380"}]},"ts":"1689172685380"} 2023-07-12 14:38:05,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 14:38:05,387 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:38:05,388 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:38:05,388 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:38:05,388 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:38:05,388 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:38:05,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, ASSIGN}] 2023-07-12 14:38:05,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, ASSIGN 2023-07-12 14:38:05,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, ASSIGN 2023-07-12 14:38:05,392 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35263,1689172568285; forceNewPlan=false, retain=false 2023-07-12 14:38:05,392 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35687,1689172568342; forceNewPlan=false, retain=false 2023-07-12 14:38:05,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 14:38:05,543 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:38:05,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a33ad853bbdedc7585f303dde215960, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:05,546 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=792591cd40e9be7ba9c8118fd977699e, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:05,546 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172685546"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172685546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172685546"}]},"ts":"1689172685546"} 2023-07-12 14:38:05,546 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172685546"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172685546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172685546"}]},"ts":"1689172685546"} 2023-07-12 14:38:05,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 8a33ad853bbdedc7585f303dde215960, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:38:05,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 792591cd40e9be7ba9c8118fd977699e, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:38:05,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 14:38:05,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a33ad853bbdedc7585f303dde215960, NAME => 'testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 14:38:05,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 792591cd40e9be7ba9c8118fd977699e, NAME => 'testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 14:38:05,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. service=AccessControlService 2023-07-12 14:38:05,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. service=AccessControlService 2023-07-12 14:38:05,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:38:05,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,710 INFO [StoreOpener-8a33ad853bbdedc7585f303dde215960-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,712 INFO [StoreOpener-792591cd40e9be7ba9c8118fd977699e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,714 DEBUG [StoreOpener-8a33ad853bbdedc7585f303dde215960-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf 2023-07-12 14:38:05,714 DEBUG [StoreOpener-8a33ad853bbdedc7585f303dde215960-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf 2023-07-12 14:38:05,715 DEBUG [StoreOpener-792591cd40e9be7ba9c8118fd977699e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf 2023-07-12 14:38:05,715 DEBUG [StoreOpener-792591cd40e9be7ba9c8118fd977699e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf 2023-07-12 14:38:05,715 INFO [StoreOpener-8a33ad853bbdedc7585f303dde215960-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a33ad853bbdedc7585f303dde215960 columnFamilyName cf 2023-07-12 14:38:05,715 INFO [StoreOpener-792591cd40e9be7ba9c8118fd977699e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 792591cd40e9be7ba9c8118fd977699e columnFamilyName cf 2023-07-12 14:38:05,716 INFO [StoreOpener-8a33ad853bbdedc7585f303dde215960-1] regionserver.HStore(310): Store=8a33ad853bbdedc7585f303dde215960/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:38:05,716 INFO [StoreOpener-792591cd40e9be7ba9c8118fd977699e-1] regionserver.HStore(310): Store=792591cd40e9be7ba9c8118fd977699e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:38:05,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:05,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:05,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:38:05,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:38:05,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8a33ad853bbdedc7585f303dde215960; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72662703, jitterRate=0.08275865018367767}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:38:05,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 792591cd40e9be7ba9c8118fd977699e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75353991, jitterRate=0.12286196649074554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:38:05,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8a33ad853bbdedc7585f303dde215960: 2023-07-12 14:38:05,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 792591cd40e9be7ba9c8118fd977699e: 2023-07-12 14:38:05,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960., pid=93, masterSystemTime=1689172685704 2023-07-12 14:38:05,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e., pid=94, masterSystemTime=1689172685704 2023-07-12 14:38:05,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,724 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=792591cd40e9be7ba9c8118fd977699e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:05,725 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172685724"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172685724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172685724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172685724"}]},"ts":"1689172685724"} 2023-07-12 14:38:05,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:05,725 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a33ad853bbdedc7585f303dde215960, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:05,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172685725"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172685725"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172685725"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172685725"}]},"ts":"1689172685725"} 2023-07-12 14:38:05,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 14:38:05,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 792591cd40e9be7ba9c8118fd977699e, server=jenkins-hbase17.apache.org,35687,1689172568342 in 174 msec 2023-07-12 14:38:05,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 14:38:05,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 8a33ad853bbdedc7585f303dde215960, server=jenkins-hbase17.apache.org,35263,1689172568285 in 176 msec 2023-07-12 14:38:05,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, ASSIGN in 340 msec 2023-07-12 14:38:05,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 14:38:05,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, ASSIGN in 341 msec 2023-07-12 14:38:05,732 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:38:05,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172685732"}]},"ts":"1689172685732"} 2023-07-12 14:38:05,735 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 14:38:05,738 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:38:05,738 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 14:38:05,740 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 14:38:05,741 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,741 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,741 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,748 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:05,749 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:05,749 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:05,749 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:05,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:05,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:05,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:05,750 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:05,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 462 msec 2023-07-12 14:38:05,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 14:38:05,898 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 14:38:05,901 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:05,901 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:05,903 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:38:05,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:38:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172685916 (current time:1689172685916). 2023-07-12 14:38:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:38:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x375e6c2f to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:05,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d74e358, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:05,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:05,946 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:05,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375e6c2f to 127.0.0.1:61257 2023-07-12 14:38:05,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:05,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x136f2fd2 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:05,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57941684, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:05,956 DEBUG [hconnection-0x7d50510d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:05,957 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x136f2fd2 to 127.0.0.1:61257 2023-07-12 14:38:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 14:38:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:38:05,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:38:05,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:38:05,967 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:38:05,968 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689173285968 2023-07-12 14:38:05,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:05,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:38:05,970 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:38:05,970 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:38:05,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 14:38:05,976 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:38:05,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-12 14:38:05,980 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 14:38:05,982 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689173285982 2023-07-12 14:38:06,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,003 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 14:38:06,003 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,004 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 14:38:06,004 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 14:38:06,005 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,005 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,007 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,007 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,007 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,007 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,008 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,008 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,008 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,008 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,009 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 14:38:06,009 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,010 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 14:38:06,010 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,018 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 14:38:06,018 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 14:38:06,020 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 14:38:06,021 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 14:38:06,022 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,022 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,022 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:06,025 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,025 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,026 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,026 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:06,026 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,026 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,027 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,027 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 14:38:06,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31695672[Count = 1] remaining members to acquire global barrier 2023-07-12 14:38:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 14:38:06,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31695672[Count = 0] remaining members to acquire global barrier 2023-07-12 14:38:06,033 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 14:38:06,033 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:38:06,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:38:06,035 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:38:06,035 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. started... 2023-07-12 14:38:06,035 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 14:38:06,035 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:38:06,035 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,036 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 14:38:06,036 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:06,036 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,036 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:06,036 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:06,041 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. started... 2023-07-12 14:38:06,036 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,041 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 14:38:06,041 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 792591cd40e9be7ba9c8118fd977699e: 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a33ad853bbdedc7585f303dde215960: 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:38:06,042 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:06,044 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:38:06,070 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:06,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:38:06,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:38:06,072 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:38:06,085 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. completed. 2023-07-12 14:38:06,085 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:06,085 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. completed. 2023-07-12 14:38:06,085 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:06,085 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:06,085 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:06,085 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,085 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:06,086 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 14:38:06,086 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:06,086 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:38:06,086 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,086 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 14:38:06,086 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:38:06,087 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,087 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 14:38:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,087 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 14:38:06,087 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,087 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,087 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 14:38:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,087 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,088 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 14:38:06,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35263,1689172568285': 2023-07-12 14:38:06,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 14:38:06,094 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 14:38:06,094 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:38:06,094 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:38:06,094 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,094 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,096 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,095 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,096 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,097 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,098 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,098 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,099 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,100 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,100 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:06,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,101 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:38:06,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,101 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,103 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,103 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,103 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,103 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,103 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 14:38:06,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 14:38:06,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,140 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689172685968Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689172686109 (+141 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689172686109Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689172686109Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689172686112 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689172686118 (+6 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689172686139 (+21 ms) 2023-07-12 14:38:06,142 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 14:38:06,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 174 msec 2023-07-12 14:38:06,272 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:06,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:38:06,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:38:06,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35687] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:38:06,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35263] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:38:06,279 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:06,279 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:06,279 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:38:06,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:38:06,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172686305 (current time:1689172686305). 2023-07-12 14:38:06,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:38:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x24ef3cab to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:06,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b48d902, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:06,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:06,323 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:06,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24ef3cab to 127.0.0.1:61257 2023-07-12 14:38:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x6cce6df3 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:06,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31990ea5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:06,343 DEBUG [hconnection-0x2c04415d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:06,348 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:06,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cce6df3 to 127.0.0.1:61257 2023-07-12 14:38:06,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:06,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 14:38:06,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:38:06,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:38:06,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:38:06,361 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:38:06,362 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689173286362 2023-07-12 14:38:06,362 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:06,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 14:38:06,364 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:38:06,364 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:38:06,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 14:38:06,365 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 14:38:06,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 14:38:06,368 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 14:38:06,369 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689173286369 2023-07-12 14:38:06,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,381 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 14:38:06,381 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,382 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 14:38:06,382 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 14:38:06,383 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,383 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,384 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,384 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,384 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:38:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 14:38:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,386 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 14:38:06,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,388 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 14:38:06,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,388 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,388 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 14:38:06,388 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 14:38:06,394 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 14:38:06,394 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 14:38:06,394 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 14:38:06,390 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 14:38:06,394 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 14:38:06,395 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,395 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,397 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,397 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,397 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,398 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:06,397 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,398 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,398 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:06,398 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,398 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36032463[Count = 1] remaining members to acquire global barrier 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 14:38:06,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36032463[Count = 0] remaining members to acquire global barrier 2023-07-12 14:38:06,400 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 14:38:06,400 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:38:06,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:06,401 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,401 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,401 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:38:06,401 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:38:06,401 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:06,401 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 14:38:06,401 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. started... 2023-07-12 14:38:06,401 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 14:38:06,402 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:38:06,402 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:06,402 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:06,402 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:06,402 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a33ad853bbdedc7585f303dde215960 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 14:38:06,402 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. started... 2023-07-12 14:38:06,402 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 792591cd40e9be7ba9c8118fd977699e 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 14:38:06,402 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 14:38:06,402 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,402 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 14:38:06,420 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712106cea3ff0b9448590d0439523c4972e to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712106cea3ff0b9448590d0439523c4972e 2023-07-12 14:38:06,421 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712f6c7a48c6afe45948f2ed90e6d7e521d to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f6c7a48c6afe45948f2ed90e6d7e521d 2023-07-12 14:38:06,440 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/.tmp/cf/e3d15550df354f3eb94691ed6ec52cd6 2023-07-12 14:38:06,440 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/.tmp/cf/891a35a30f504a8e9c7b483c8e3900d3 2023-07-12 14:38:06,444 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/.tmp/cf/e3d15550df354f3eb94691ed6ec52cd6 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf/e3d15550df354f3eb94691ed6ec52cd6 2023-07-12 14:38:06,445 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/.tmp/cf/891a35a30f504a8e9c7b483c8e3900d3 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf/891a35a30f504a8e9c7b483c8e3900d3 2023-07-12 14:38:06,449 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf/e3d15550df354f3eb94691ed6ec52cd6, entries=2, sequenceid=6, filesize=5.2 K 2023-07-12 14:38:06,449 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf/891a35a30f504a8e9c7b483c8e3900d3, entries=48, sequenceid=6, filesize=13.2 K 2023-07-12 14:38:06,450 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 792591cd40e9be7ba9c8118fd977699e in 48ms, sequenceid=6, compaction requested=false 2023-07-12 14:38:06,450 INFO [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 8a33ad853bbdedc7585f303dde215960 in 48ms, sequenceid=6, compaction requested=false 2023-07-12 14:38:06,450 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 14:38:06,450 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 14:38:06,453 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 792591cd40e9be7ba9c8118fd977699e: 2023-07-12 14:38:06,453 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a33ad853bbdedc7585f303dde215960: 2023-07-12 14:38:06,453 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,453 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,454 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:06,454 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:06,454 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf/e3d15550df354f3eb94691ed6ec52cd6] hfiles 2023-07-12 14:38:06,454 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf/891a35a30f504a8e9c7b483c8e3900d3] hfiles 2023-07-12 14:38:06,454 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf/e3d15550df354f3eb94691ed6ec52cd6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,454 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf/891a35a30f504a8e9c7b483c8e3900d3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,461 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. completed. 2023-07-12 14:38:06,461 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:38:06,461 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. completed. 2023-07-12 14:38:06,461 DEBUG [rs(jenkins-hbase17.apache.org,35263,1689172568285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 14:38:06,461 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:38:06,462 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,462 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 14:38:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,462 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,462 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 14:38:06,463 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,463 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 14:38:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,464 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,464 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 14:38:06,464 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:38:06,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:38:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,465 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:38:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:38:06,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 14:38:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35263,1689172568285': 2023-07-12 14:38:06,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 14:38:06,471 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 14:38:06,471 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:38:06,471 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:38:06,471 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,471 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:38:06,472 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,472 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,473 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,473 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,474 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,475 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,476 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,476 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,476 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,478 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,478 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,478 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,478 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,479 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,479 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:06,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,480 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:06,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:06,480 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:06,482 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:06,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:38:06,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-12 14:38:06,482 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:06,482 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:06,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,483 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:06,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f6c7a48c6afe45948f2ed90e6d7e521d, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712106cea3ff0b9448590d0439523c4972e] mob files 2023-07-12 14:38:06,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f6c7a48c6afe45948f2ed90e6d7e521d 2023-07-12 14:38:06,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712106cea3ff0b9448590d0439523c4972e 2023-07-12 14:38:06,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 14:38:06,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689172686362Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689172686491 (+129 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689172686491Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689172686492 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689172686499 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689172686521 (+22 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689172686576 (+55 ms) 2023-07-12 14:38:06,580 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 14:38:06,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 217 msec 2023-07-12 14:38:06,666 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 14:38:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:38:06,667 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667 2023-07-12 14:38:06,667 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:36845, tgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667, rawTgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:38:06,689 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:38:06,689 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-972426239_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,689 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 14:38:06,695 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:06,748 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:06,748 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:06,749 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:06,749 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,770 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-7395516585577618983.jar 2023-07-12 14:38:07,771 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,771 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,832 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-2292993031454865947.jar 2023-07-12 14:38:07,833 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,833 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,833 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,834 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,834 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,834 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:07,835 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:38:07,835 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:38:07,836 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:38:07,836 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:38:07,837 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:38:07,837 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:38:07,838 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:38:07,838 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:38:07,839 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:38:07,840 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:38:07,840 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:07,841 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:07,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:38:07,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:07,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:07,843 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:38:07,844 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:38:07,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0005_000001 (auth:SIMPLE) 2023-07-12 14:38:09,446 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:38:10,265 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:38:10,269 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 14:38:10,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:38:10,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:38:10,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0006_000001 (auth:SIMPLE) 2023-07-12 14:38:16,662 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0006_000001 (auth:SIMPLE) 2023-07-12 14:38:19,730 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:38:19,731 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:38:19,736 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:19,737 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:38:19,737 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:38:19,737 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:19,738 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 14:38:19,738 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 14:38:19,738 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:19,738 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 14:38:19,738 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172686667/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 14:38:19,744 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 14:38:19,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-07-12 14:38:19,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:19,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 14:38:19,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172699752"}]},"ts":"1689172699752"} 2023-07-12 14:38:19,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 14:38:19,754 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 14:38:19,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, UNASSIGN}] 2023-07-12 14:38:19,759 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, UNASSIGN 2023-07-12 14:38:19,759 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, UNASSIGN 2023-07-12 14:38:19,760 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=792591cd40e9be7ba9c8118fd977699e, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:19,760 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a33ad853bbdedc7585f303dde215960, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:19,760 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172699760"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172699760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172699760"}]},"ts":"1689172699760"} 2023-07-12 14:38:19,760 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172699760"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172699760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172699760"}]},"ts":"1689172699760"} 2023-07-12 14:38:19,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 792591cd40e9be7ba9c8118fd977699e, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:38:19,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 8a33ad853bbdedc7585f303dde215960, server=jenkins-hbase17.apache.org,35263,1689172568285}] 2023-07-12 14:38:19,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 14:38:19,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:19,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 792591cd40e9be7ba9c8118fd977699e, disabling compactions & flushes 2023-07-12 14:38:19,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:19,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:19,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. after waiting 0 ms 2023-07-12 14:38:19,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:19,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:19,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8a33ad853bbdedc7585f303dde215960, disabling compactions & flushes 2023-07-12 14:38:19,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:19,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:19,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. after waiting 0 ms 2023-07-12 14:38:19,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:19,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:38:19,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:38:19,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:19,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960. 2023-07-12 14:38:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8a33ad853bbdedc7585f303dde215960: 2023-07-12 14:38:19,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:19,930 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a33ad853bbdedc7585f303dde215960, regionState=CLOSED 2023-07-12 14:38:19,931 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172699930"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172699930"}]},"ts":"1689172699930"} 2023-07-12 14:38:19,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e. 2023-07-12 14:38:19,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 792591cd40e9be7ba9c8118fd977699e: 2023-07-12 14:38:19,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-12 14:38:19,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 8a33ad853bbdedc7585f303dde215960, server=jenkins-hbase17.apache.org,35263,1689172568285 in 168 msec 2023-07-12 14:38:19,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:19,940 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=792591cd40e9be7ba9c8118fd977699e, regionState=CLOSED 2023-07-12 14:38:19,940 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689172699940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172699940"}]},"ts":"1689172699940"} 2023-07-12 14:38:19,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a33ad853bbdedc7585f303dde215960, UNASSIGN in 184 msec 2023-07-12 14:38:19,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-12 14:38:19,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 792591cd40e9be7ba9c8118fd977699e, server=jenkins-hbase17.apache.org,35687,1689172568342 in 180 msec 2023-07-12 14:38:19,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-12 14:38:19,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=792591cd40e9be7ba9c8118fd977699e, UNASSIGN in 189 msec 2023-07-12 14:38:19,946 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172699946"}]},"ts":"1689172699946"} 2023-07-12 14:38:19,947 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 14:38:19,948 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 14:38:19,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 205 msec 2023-07-12 14:38:20,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 14:38:20,051 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 14:38:20,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,056 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,057 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,059 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,059 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,059 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,059 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 14:38:20,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 14:38:20,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 14:38:20,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 14:38:20,060 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,060 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,060 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,060 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,061 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,061 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,061 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,061 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 14:38:20,061 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:20,061 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:20,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/recovered.edits] 2023-07-12 14:38:20,064 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/recovered.edits] 2023-07-12 14:38:20,069 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf/891a35a30f504a8e9c7b483c8e3900d3 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/cf/891a35a30f504a8e9c7b483c8e3900d3 2023-07-12 14:38:20,069 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf/e3d15550df354f3eb94691ed6ec52cd6 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/cf/e3d15550df354f3eb94691ed6ec52cd6 2023-07-12 14:38:20,072 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960/recovered.edits/9.seqid 2023-07-12 14:38:20,072 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e/recovered.edits/9.seqid 2023-07-12 14:38:20,073 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a33ad853bbdedc7585f303dde215960 2023-07-12 14:38:20,073 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testEmptyExportFileSystemState/792591cd40e9be7ba9c8118fd977699e 2023-07-12 14:38:20,073 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 14:38:20,073 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 14:38:20,074 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 14:38:20,077 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f6c7a48c6afe45948f2ed90e6d7e521d to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f6c7a48c6afe45948f2ed90e6d7e521d 2023-07-12 14:38:20,078 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712106cea3ff0b9448590d0439523c4972e to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712106cea3ff0b9448590d0439523c4972e 2023-07-12 14:38:20,078 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 14:38:20,085 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,087 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 14:38:20,089 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 14:38:20,090 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,091 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 14:38:20,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172700091"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:20,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172700091"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:20,096 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 14:38:20,096 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 792591cd40e9be7ba9c8118fd977699e, NAME => 'testtb-testEmptyExportFileSystemState,,1689172685287.792591cd40e9be7ba9c8118fd977699e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a33ad853bbdedc7585f303dde215960, NAME => 'testtb-testEmptyExportFileSystemState,1,1689172685287.8a33ad853bbdedc7585f303dde215960.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 14:38:20,096 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 14:38:20,096 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172700096"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:20,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 14:38:20,103 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 14:38:20,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 51 msec 2023-07-12 14:38:20,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 14:38:20,163 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 14:38:20,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 14:38:20,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:20,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 14:38:20,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 14:38:20,214 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 754) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:34557 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (293937167) connection to jenkins-hbase17.apache.org/136.243.18.41:43125 from appattempt_1689172578979_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:47922 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4917 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_84227335_1 at /127.0.0.1:59088 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1870908945_17 at /127.0.0.1:59876 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6dc26636-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=673 (was 645) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=769 (was 977) 2023-07-12 14:38:20,214 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 14:38:20,245 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=673, ProcessCount=185, AvailableMemoryMB=767 2023-07-12 14:38:20,245 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 14:38:20,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 14:38:20,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,253 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 14:38:20,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 14:38:20,254 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 14:38:20,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 14:38:20,256 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,256 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,257 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f empty. 2023-07-12 14:38:20,257 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 empty. 2023-07-12 14:38:20,257 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,257 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,257 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 14:38:20,275 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 14:38:20,276 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19ea63525a6de35a21ec90b7fa0a6050, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:38:20,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1b533462ddf834e832feb39357afd29f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp 2023-07-12 14:38:20,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:20,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 1b533462ddf834e832feb39357afd29f, disabling compactions & flushes 2023-07-12 14:38:20,305 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. after waiting 0 ms 2023-07-12 14:38:20,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,305 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,305 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 1b533462ddf834e832feb39357afd29f: 2023-07-12 14:38:20,306 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:20,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 19ea63525a6de35a21ec90b7fa0a6050, disabling compactions & flushes 2023-07-12 14:38:20,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. after waiting 0 ms 2023-07-12 14:38:20,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,307 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 19ea63525a6de35a21ec90b7fa0a6050: 2023-07-12 14:38:20,309 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 14:38:20,310 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172700310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172700310"}]},"ts":"1689172700310"} 2023-07-12 14:38:20,310 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172700310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172700310"}]},"ts":"1689172700310"} 2023-07-12 14:38:20,312 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 14:38:20,313 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 14:38:20,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172700313"}]},"ts":"1689172700313"} 2023-07-12 14:38:20,315 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 14:38:20,317 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-12 14:38:20,318 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 14:38:20,318 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 14:38:20,318 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 14:38:20,318 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 14:38:20,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, ASSIGN}] 2023-07-12 14:38:20,321 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, ASSIGN 2023-07-12 14:38:20,321 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, ASSIGN 2023-07-12 14:38:20,322 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35687,1689172568342; forceNewPlan=false, retain=false 2023-07-12 14:38:20,322 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36691,1689172568228; forceNewPlan=false, retain=false 2023-07-12 14:38:20,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 14:38:20,472 INFO [jenkins-hbase17:35815] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 14:38:20,479 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=19ea63525a6de35a21ec90b7fa0a6050, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1b533462ddf834e832feb39357afd29f, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172700479"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172700479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172700479"}]},"ts":"1689172700479"} 2023-07-12 14:38:20,480 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172700479"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172700479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172700479"}]},"ts":"1689172700479"} 2023-07-12 14:38:20,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 19ea63525a6de35a21ec90b7fa0a6050, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:38:20,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 1b533462ddf834e832feb39357afd29f, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:38:20,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 14:38:20,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b533462ddf834e832feb39357afd29f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19ea63525a6de35a21ec90b7fa0a6050, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. service=AccessControlService 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. service=AccessControlService 2023-07-12 14:38:20,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,642 INFO [StoreOpener-19ea63525a6de35a21ec90b7fa0a6050-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,642 INFO [StoreOpener-1b533462ddf834e832feb39357afd29f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,643 DEBUG [StoreOpener-19ea63525a6de35a21ec90b7fa0a6050-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf 2023-07-12 14:38:20,643 DEBUG [StoreOpener-19ea63525a6de35a21ec90b7fa0a6050-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf 2023-07-12 14:38:20,643 INFO [StoreOpener-19ea63525a6de35a21ec90b7fa0a6050-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19ea63525a6de35a21ec90b7fa0a6050 columnFamilyName cf 2023-07-12 14:38:20,645 INFO [StoreOpener-19ea63525a6de35a21ec90b7fa0a6050-1] regionserver.HStore(310): Store=19ea63525a6de35a21ec90b7fa0a6050/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:38:20,645 DEBUG [StoreOpener-1b533462ddf834e832feb39357afd29f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf 2023-07-12 14:38:20,645 DEBUG [StoreOpener-1b533462ddf834e832feb39357afd29f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf 2023-07-12 14:38:20,645 INFO [StoreOpener-1b533462ddf834e832feb39357afd29f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b533462ddf834e832feb39357afd29f columnFamilyName cf 2023-07-12 14:38:20,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,646 INFO [StoreOpener-1b533462ddf834e832feb39357afd29f-1] regionserver.HStore(310): Store=1b533462ddf834e832feb39357afd29f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 14:38:20,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:20,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:20,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:38:20,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 19ea63525a6de35a21ec90b7fa0a6050; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61063339, jitterRate=-0.09008534252643585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:38:20,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 19ea63525a6de35a21ec90b7fa0a6050: 2023-07-12 14:38:20,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050., pid=108, masterSystemTime=1689172700636 2023-07-12 14:38:20,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=19ea63525a6de35a21ec90b7fa0a6050, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,653 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172700653"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172700653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172700653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172700653"}]},"ts":"1689172700653"} 2023-07-12 14:38:20,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-12 14:38:20,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 19ea63525a6de35a21ec90b7fa0a6050, server=jenkins-hbase17.apache.org,36691,1689172568228 in 173 msec 2023-07-12 14:38:20,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 14:38:20,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1b533462ddf834e832feb39357afd29f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59567356, jitterRate=-0.11237722635269165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 14:38:20,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1b533462ddf834e832feb39357afd29f: 2023-07-12 14:38:20,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, ASSIGN in 338 msec 2023-07-12 14:38:20,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f., pid=109, masterSystemTime=1689172700636 2023-07-12 14:38:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,660 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1b533462ddf834e832feb39357afd29f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,660 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172700660"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689172700660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689172700660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689172700660"}]},"ts":"1689172700660"} 2023-07-12 14:38:20,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-12 14:38:20,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 1b533462ddf834e832feb39357afd29f, server=jenkins-hbase17.apache.org,35687,1689172568342 in 178 msec 2023-07-12 14:38:20,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 14:38:20,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, ASSIGN in 344 msec 2023-07-12 14:38:20,664 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 14:38:20,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172700664"}]},"ts":"1689172700664"} 2023-07-12 14:38:20,665 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 14:38:20,667 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 14:38:20,667 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 14:38:20,668 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 14:38:20,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,669 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:20,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:20,671 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:20,671 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:20,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 423 msec 2023-07-12 14:38:20,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 14:38:20,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 14:38:20,858 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 14:38:20,860 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,860 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,862 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:38:20,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 14:38:20,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172700877 (current time:1689172700877). 2023-07-12 14:38:20,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:38:20,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x7088ee33 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:20,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d640572, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:20,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:20,894 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:20,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7088ee33 to 127.0.0.1:61257 2023-07-12 14:38:20,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:20,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x3ded3d07 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:20,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aa3a5ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:20,912 DEBUG [hconnection-0x17f17e4c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:20,916 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:20,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ded3d07 to 127.0.0.1:61257 2023-07-12 14:38:20,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:20,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 14:38:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:38:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 14:38:20,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 14:38:20,927 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 14:38:20,928 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689173300928 2023-07-12 14:38:20,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 14:38:20,930 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:38:20,930 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:38:20,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 14:38:20,932 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 14:38:20,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-12 14:38:20,935 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 14:38:20,936 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689173300936 2023-07-12 14:38:20,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,945 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 14:38:20,945 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:20,947 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 14:38:20,947 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 14:38:20,947 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,947 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,949 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:20,950 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:20,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:20,950 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:20,950 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,950 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,950 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,950 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,950 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:38:20,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,951 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 14:38:20,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,951 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:20,951 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 14:38:20,953 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 14:38:20,953 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 14:38:20,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:20,953 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 14:38:20,953 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:20,955 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 14:38:20,955 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 14:38:20,955 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 14:38:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,958 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,958 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:20,958 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:20,958 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,958 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:20,958 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:20,958 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,959 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 14:38:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,959 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,959 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 14:38:20,959 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:20,960 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 14:38:20,960 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 14:38:20,960 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 14:38:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:20,961 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,962 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19ceba87[Count = 1] remaining members to acquire global barrier 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:20,962 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,962 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:20,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 14:38:20,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19ceba87[Count = 0] remaining members to acquire global barrier 2023-07-12 14:38:20,964 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 14:38:20,964 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 14:38:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 14:38:20,965 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,965 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 14:38:20,965 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:20,965 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. started... 2023-07-12 14:38:20,965 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:38:20,965 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:20,966 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. started... 2023-07-12 14:38:20,966 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19ea63525a6de35a21ec90b7fa0a6050: 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b533462ddf834e832feb39357afd29f: 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:20,967 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 14:38:20,968 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 14:38:20,968 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:20,968 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 14:38:20,983 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. completed. 2023-07-12 14:38:20,983 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:20,983 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:20,983 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:20,983 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,983 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 14:38:20,983 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:38:20,984 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 14:38:20,984 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,984 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:20,985 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 14:38:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:38:20,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 14:38:21,030 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:21,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 14:38:21,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:38:21,032 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:38:21,232 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:21,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 14:38:21,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:38:21,233 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 14:38:21,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. completed. 2023-07-12 14:38:21,377 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:21,377 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:21,377 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:21,377 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,377 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 14:38:21,377 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:38:21,378 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,378 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 14:38:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,378 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:21,379 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 14:38:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:38:21,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 14:38:21,384 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 14:38:21,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:38:21,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:38:21,384 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,384 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,386 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,386 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,387 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,388 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,388 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,388 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,390 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:21,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,390 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:38:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 14:38:21,392 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 14:38:21,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,434 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689172700928Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689172701398 (+470 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689172701398Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689172701398Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689172701401 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689172701410 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689172701434 (+24 ms) 2023-07-12 14:38:21,437 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 14:38:21,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 507 msec 2023-07-12 14:38:21,533 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:21,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 14:38:21,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:38:21,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36691] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:38:21,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35687] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 14:38:21,547 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,548 DEBUG [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:21,548 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 14:38:21,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 14:38:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689172701559 (current time:1689172701559). 2023-07-12 14:38:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 14:38:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x3461bcdc to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:21,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28feb702, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:21,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:21,572 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:21,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3461bcdc to 127.0.0.1:61257 2023-07-12 14:38:21,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:21,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(139): Connect 0x74042244 to 127.0.0.1:61257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 14:38:21,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d3af744, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 14:38:21,593 DEBUG [hconnection-0x10a10f46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 14:38:21,594 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 14:38:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74042244 to 127.0.0.1:61257 2023-07-12 14:38:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:38:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 14:38:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 14:38:21,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 14:38:21,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 14:38:21,605 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 14:38:21,606 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689173301606 2023-07-12 14:38:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 14:38:21,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,611 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 14:38:21,611 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 14:38:21,611 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 14:38:21,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 14:38:21,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 14:38:21,616 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 14:38:21,617 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689173301617 2023-07-12 14:38:21,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,634 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 14:38:21,634 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:21,635 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 14:38:21,635 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 14:38:21,636 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,636 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,636 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,636 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,636 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,636 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,637 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,637 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,637 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 14:38:21,637 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 14:38:21,638 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 14:38:21,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,638 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 14:38:21,638 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 14:38:21,638 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:21,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,639 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 14:38:21,639 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 14:38:21,638 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:21,639 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 14:38:21,639 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 14:38:21,640 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35263,1689172568285' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 14:38:21,643 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,643 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,643 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,643 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,643 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,644 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,644 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,644 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:21,644 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,644 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,644 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 14:38:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36691,1689172568228' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14b67965[Count = 1] remaining members to acquire global barrier 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35687,1689172568342' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 14:38:21,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14b67965[Count = 0] remaining members to acquire global barrier 2023-07-12 14:38:21,647 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 14:38:21,647 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 14:38:21,648 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 14:38:21,648 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35263,1689172568285' in zk 2023-07-12 14:38:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,648 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 14:38:21,648 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 14:38:21,648 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,648 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 14:38:21,648 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:21,649 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:21,649 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:21,649 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. started... 2023-07-12 14:38:21,649 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1b533462ddf834e832feb39357afd29f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 14:38:21,649 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 14:38:21,649 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 14:38:21,649 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 14:38:21,649 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:21,649 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:21,649 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. started... 2023-07-12 14:38:21,649 DEBUG [member: 'jenkins-hbase17.apache.org,35263,1689172568285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 14:38:21,651 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 19ea63525a6de35a21ec90b7fa0a6050 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 14:38:21,670 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712eec416dbd7a94195b90de5d7cd137bf4 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712eec416dbd7a94195b90de5d7cd137bf4 2023-07-12 14:38:21,671 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307127019f4c4353548e285eff06046bdea7f to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127019f4c4353548e285eff06046bdea7f 2023-07-12 14:38:21,688 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/.tmp/cf/dcc2ed43da2d468f81203b008ed5b288 2023-07-12 14:38:21,689 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/.tmp/cf/fd907b1bf1cd4456827a226526c6fb0d 2023-07-12 14:38:21,693 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/.tmp/cf/dcc2ed43da2d468f81203b008ed5b288 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf/dcc2ed43da2d468f81203b008ed5b288 2023-07-12 14:38:21,693 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/.tmp/cf/fd907b1bf1cd4456827a226526c6fb0d as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf/fd907b1bf1cd4456827a226526c6fb0d 2023-07-12 14:38:21,697 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf/dcc2ed43da2d468f81203b008ed5b288, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 14:38:21,697 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf/fd907b1bf1cd4456827a226526c6fb0d, entries=47, sequenceid=6, filesize=13.4 K 2023-07-12 14:38:21,698 INFO [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 19ea63525a6de35a21ec90b7fa0a6050 in 47ms, sequenceid=6, compaction requested=false 2023-07-12 14:38:21,698 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 14:38:21,698 INFO [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1b533462ddf834e832feb39357afd29f in 49ms, sequenceid=6, compaction requested=false 2023-07-12 14:38:21,698 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19ea63525a6de35a21ec90b7fa0a6050: 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b533462ddf834e832feb39357afd29f: 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf/fd907b1bf1cd4456827a226526c6fb0d] hfiles 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf/dcc2ed43da2d468f81203b008ed5b288] hfiles 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf/fd907b1bf1cd4456827a226526c6fb0d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,701 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf/dcc2ed43da2d468f81203b008ed5b288 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,714 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:21,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 14:38:21,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 14:38:21,717 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 14:38:21,717 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. completed. 2023-07-12 14:38:21,717 DEBUG [rs(jenkins-hbase17.apache.org,35687,1689172568342)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:21,718 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:21,718 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:21,718 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,718 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 14:38:21,718 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35687,1689172568342' in zk 2023-07-12 14:38:21,719 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,719 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 14:38:21,719 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,719 DEBUG [member: 'jenkins-hbase17.apache.org,35687,1689172568342' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 14:38:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,721 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. completed. 2023-07-12 14:38:21,721 DEBUG [rs(jenkins-hbase17.apache.org,36691,1689172568228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:21,721 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 14:38:21,721 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 14:38:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,721 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,721 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 14:38:21,721 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36691,1689172568228' in zk 2023-07-12 14:38:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,722 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,722 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 14:38:21,722 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:21,722 DEBUG [member: 'jenkins-hbase17.apache.org,36691,1689172568228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 14:38:21,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,35687,1689172568342': 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35687,1689172568342' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36691,1689172568228': 2023-07-12 14:38:21,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36691,1689172568228' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 14:38:21,728 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 14:38:21,728 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 14:38:21,728 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 14:38:21,728 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,728 INFO [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 14:38:21,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 14:38:21,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,730 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,729 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,730 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,730 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 14:38:21,732 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,732 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,732 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,734 DEBUG [(jenkins-hbase17.apache.org,35815,1689172566719)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 14:38:21,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,734 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 14:38:21,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 14:38:21,736 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,736 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:38:21,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 14:38:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 14:38:21,736 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,736 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,736 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:21,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 14:38:21,736 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,737 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 14:38:21,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127019f4c4353548e285eff06046bdea7f, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712eec416dbd7a94195b90de5d7cd137bf4] mob files 2023-07-12 14:38:21,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127019f4c4353548e285eff06046bdea7f 2023-07-12 14:38:21,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712eec416dbd7a94195b90de5d7cd137bf4 2023-07-12 14:38:21,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 14:38:21,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,783 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689172701607Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689172701743 (+136 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689172701743Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689172701743Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689172701746 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689172701755 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689172701783 (+28 ms) 2023-07-12 14:38:21,787 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 14:38:21,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 178 msec 2023-07-12 14:38:21,917 DEBUG [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 14:38:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 14:38:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 14:38:21,918 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918 2023-07-12 14:38:21,918 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:36845, tgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918, rawTgtDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918, srcFsUri=hdfs://localhost.localdomain:36845, srcDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:38:21,937 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9 2023-07-12 14:38:21,937 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1767231258_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,937 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:36845, inputRoot=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9, snapshotDir=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 14:38:21,945 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:21,973 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:21,973 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:21,973 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:21,974 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,783 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-10353561619155729.jar 2023-07-12 14:38:22,783 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,784 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,839 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/hadoop-3531062189739303943.jar 2023-07-12 14:38:22,840 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,840 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,841 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,841 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 14:38:22,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 14:38:22,842 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 14:38:22,843 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 14:38:22,843 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 14:38:22,843 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 14:38:22,844 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 14:38:22,844 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 14:38:22,844 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 14:38:22,844 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 14:38:22,845 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 14:38:22,845 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:22,846 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:22,846 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:38:22,846 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:22,846 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 14:38:22,847 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:38:22,847 DEBUG [Listener at jenkins-hbase17.apache.org/34087] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 14:38:23,290 WARN [Listener at jenkins-hbase17.apache.org/34087] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 14:38:23,292 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 14:38:23,294 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 14:38:24,064 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:38:24,065 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 14:38:24,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0006_000001 (auth:SIMPLE) 2023-07-12 14:38:24,148 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0007_000001 (auth:SIMPLE) 2023-07-12 14:38:25,599 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:38:30,083 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0007_000001 (auth:SIMPLE) 2023-07-12 14:38:32,311 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0007_000001 (auth:SIMPLE) 2023-07-12 14:38:36,327 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0007_000001 (auth:SIMPLE) 2023-07-12 14:38:36,337 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689172578979_0007_01_000002 is : 143 2023-07-12 14:38:37,495 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 14:38:37,495 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 14:38:37,503 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:37,504 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 14:38:37,504 INFO [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 14:38:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:37,504 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 14:38:37,505 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 14:38:37,505 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1870908945_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:37,505 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 14:38:37,505 DEBUG [Listener at jenkins-hbase17.apache.org/34087] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/export-test/export-1689172701918/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 14:38:37,510 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:37,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:37,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:37,657 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData-prefix:jenkins-hbase17.apache.org,35815,1689172566719] wal.AbstractFSWAL(1141): Slow sync cost: 146 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:33445,DS-8dfac479-61f8-41aa-819d-54f6bba05e5c,DISK], DatanodeInfoWithStorage[127.0.0.1:36877,DS-02f6b90a-8ddb-4557-8d36-6ccfb46bad83,DISK], DatanodeInfoWithStorage[127.0.0.1:46153,DS-7e7a9bde-663a-4b22-b7a6-eca0ab5df991,DISK]] 2023-07-12 14:38:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 14:38:37,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172717662"}]},"ts":"1689172717662"} 2023-07-12 14:38:37,664 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 14:38:37,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 14:38:37,954 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 14:38:37,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, UNASSIGN}] 2023-07-12 14:38:37,958 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, UNASSIGN 2023-07-12 14:38:37,958 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, UNASSIGN 2023-07-12 14:38:37,958 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=1b533462ddf834e832feb39357afd29f, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:38:37,958 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=19ea63525a6de35a21ec90b7fa0a6050, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:38:37,959 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172717958"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172717958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172717958"}]},"ts":"1689172717958"} 2023-07-12 14:38:37,959 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172717958"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689172717958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689172717958"}]},"ts":"1689172717958"} 2023-07-12 14:38:37,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 19ea63525a6de35a21ec90b7fa0a6050, server=jenkins-hbase17.apache.org,36691,1689172568228}] 2023-07-12 14:38:37,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 1b533462ddf834e832feb39357afd29f, server=jenkins-hbase17.apache.org,35687,1689172568342}] 2023-07-12 14:38:37,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 14:38:38,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:38,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 19ea63525a6de35a21ec90b7fa0a6050, disabling compactions & flushes 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1b533462ddf834e832feb39357afd29f, disabling compactions & flushes 2023-07-12 14:38:38,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:38,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. after waiting 0 ms 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. after waiting 0 ms 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:38,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:38:38,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:38:38,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:38,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:38:38,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f. 2023-07-12 14:38:38,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050. 2023-07-12 14:38:38,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1b533462ddf834e832feb39357afd29f: 2023-07-12 14:38:38,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 19ea63525a6de35a21ec90b7fa0a6050: 2023-07-12 14:38:38,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:38,135 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=19ea63525a6de35a21ec90b7fa0a6050, regionState=CLOSED 2023-07-12 14:38:38,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172718135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172718135"}]},"ts":"1689172718135"} 2023-07-12 14:38:38,136 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=1b533462ddf834e832feb39357afd29f, regionState=CLOSED 2023-07-12 14:38:38,136 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689172718136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689172718136"}]},"ts":"1689172718136"} 2023-07-12 14:38:38,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:38,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 14:38:38,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 19ea63525a6de35a21ec90b7fa0a6050, server=jenkins-hbase17.apache.org,36691,1689172568228 in 177 msec 2023-07-12 14:38:38,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 14:38:38,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=19ea63525a6de35a21ec90b7fa0a6050, UNASSIGN in 183 msec 2023-07-12 14:38:38,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 1b533462ddf834e832feb39357afd29f, server=jenkins-hbase17.apache.org,35687,1689172568342 in 176 msec 2023-07-12 14:38:38,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 14:38:38,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1b533462ddf834e832feb39357afd29f, UNASSIGN in 185 msec 2023-07-12 14:38:38,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689172718142"}]},"ts":"1689172718142"} 2023-07-12 14:38:38,143 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 14:38:38,247 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 14:38:38,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 739 msec 2023-07-12 14:38:38,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 14:38:38,266 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 14:38:38,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,276 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,278 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36691] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,283 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:38,286 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:38,288 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/recovered.edits] 2023-07-12 14:38:38,288 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf, FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/recovered.edits] 2023-07-12 14:38:38,293 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf/fd907b1bf1cd4456827a226526c6fb0d to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/cf/fd907b1bf1cd4456827a226526c6fb0d 2023-07-12 14:38:38,293 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf/dcc2ed43da2d468f81203b008ed5b288 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/cf/dcc2ed43da2d468f81203b008ed5b288 2023-07-12 14:38:38,297 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f/recovered.edits/9.seqid 2023-07-12 14:38:38,297 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1b533462ddf834e832feb39357afd29f 2023-07-12 14:38:38,298 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/recovered.edits/9.seqid to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050/recovered.edits/9.seqid 2023-07-12 14:38:38,298 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/19ea63525a6de35a21ec90b7fa0a6050 2023-07-12 14:38:38,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 14:38:38,320 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 14:38:38,325 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 14:38:38,328 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127019f4c4353548e285eff06046bdea7f to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127019f4c4353548e285eff06046bdea7f 2023-07-12 14:38:38,329 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712eec416dbd7a94195b90de5d7cd137bf4 to hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712eec416dbd7a94195b90de5d7cd137bf4 2023-07-12 14:38:38,329 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 14:38:38,331 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,334 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 14:38:38,936 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,936 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,936 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,936 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 14:38:38,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 14:38:38,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 14:38:38,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 14:38:38,948 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:38,949 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 14:38:38,949 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172718949"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:38,949 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689172718949"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:38,957 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 14:38:38,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 19ea63525a6de35a21ec90b7fa0a6050, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689172700247.19ea63525a6de35a21ec90b7fa0a6050.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1b533462ddf834e832feb39357afd29f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689172700247.1b533462ddf834e832feb39357afd29f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 14:38:38,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 14:38:38,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689172718957"}]},"ts":"9223372036854775807"} 2023-07-12 14:38:38,962 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:39,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:39,161 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 14:38:39,161 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 14:38:39,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 14:38:39,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 14:38:39,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 14:38:39,519 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:39,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 1.2530 sec 2023-07-12 14:38:39,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 14:38:39,769 INFO [Listener at jenkins-hbase17.apache.org/34087] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 14:38:39,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 14:38:39,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:39,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 14:38:39,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35815] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 14:38:39,808 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 763), OpenFileDescriptor=894 (was 915), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=616 (was 673), ProcessCount=185 (was 185), AvailableMemoryMB=894 (was 767) - AvailableMemoryMB LEAK? - 2023-07-12 14:38:39,808 WARN [Listener at jenkins-hbase17.apache.org/34087] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 14:38:39,808 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 14:38:39,819 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-12 14:38:42,429 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689172578979_0007_000001 (auth:SIMPLE) 2023-07-12 14:38:43,710 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 14:38:53,955 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-12 14:39:08,084 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 14:39:08,085 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-12 14:39:08,104 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 14:39:08,119 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 14:39:08,122 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 14:39:08,139 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-12 14:39:08,246 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 14:39:08,246 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 14:39:08,246 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 14:39:08,246 INFO [Listener at jenkins-hbase17.apache.org/34087] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 14:39:08,246 DEBUG [Listener at jenkins-hbase17.apache.org/34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13743ba0 to 127.0.0.1:61257 2023-07-12 14:39:08,246 DEBUG [Listener at jenkins-hbase17.apache.org/34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,247 DEBUG [Listener at jenkins-hbase17.apache.org/34087] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 14:39:08,247 DEBUG [Listener at jenkins-hbase17.apache.org/34087] util.JVMClusterUtil(257): Found active master hash=1051936403, stopped=false 2023-07-12 14:39:08,247 DEBUG [Listener at jenkins-hbase17.apache.org/34087] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,247 DEBUG [Listener at jenkins-hbase17.apache.org/34087] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 14:39:08,247 INFO [Listener at jenkins-hbase17.apache.org/34087] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:39:08,248 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 14:39:08,248 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 14:39:08,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:39:08,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:39:08,250 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 14:39:08,250 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 14:39:08,250 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:39:08,250 INFO [Listener at jenkins-hbase17.apache.org/34087] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 14:39:08,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:39:08,250 DEBUG [Listener at jenkins-hbase17.apache.org/34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04e00eb1 to 127.0.0.1:61257 2023-07-12 14:39:08,250 DEBUG [Listener at jenkins-hbase17.apache.org/34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,250 INFO [Listener at jenkins-hbase17.apache.org/34087] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,36691,1689172568228' ***** 2023-07-12 14:39:08,251 DEBUG [Listener at jenkins-hbase17.apache.org/34087] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,251 INFO [Listener at jenkins-hbase17.apache.org/34087] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 14:39:08,251 INFO [Listener at jenkins-hbase17.apache.org/34087] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35263,1689172568285' ***** 2023-07-12 14:39:08,251 DEBUG [Listener at jenkins-hbase17.apache.org/34087] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,251 INFO [Listener at jenkins-hbase17.apache.org/34087] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 14:39:08,251 INFO [RS:0;jenkins-hbase17:36691] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 14:39:08,251 INFO [RS:1;jenkins-hbase17:35263] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 14:39:08,251 INFO [RS:0;jenkins-hbase17:36691] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 14:39:08,251 INFO [RS:1;jenkins-hbase17:35263] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 14:39:08,251 INFO [RS:0;jenkins-hbase17:36691] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 14:39:08,251 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 14:39:08,251 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 14:39:08,251 INFO [Listener at jenkins-hbase17.apache.org/34087] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35687,1689172568342' ***** 2023-07-12 14:39:08,251 INFO [RS:1;jenkins-hbase17:35263] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 14:39:08,252 DEBUG [Listener at jenkins-hbase17.apache.org/34087] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,252 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(3305): Received CLOSE for e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:39:08,252 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:39:08,252 DEBUG [RS:1;jenkins-hbase17:35263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f3d8d77 to 127.0.0.1:61257 2023-07-12 14:39:08,252 DEBUG [RS:1;jenkins-hbase17:35263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,252 INFO [Listener at jenkins-hbase17.apache.org/34087] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 14:39:08,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 14:39:08,253 INFO [RS:2;jenkins-hbase17:35687] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 14:39:08,253 INFO [RS:2;jenkins-hbase17:35687] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 14:39:08,253 INFO [RS:2;jenkins-hbase17:35687] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 14:39:08,253 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:39:08,254 DEBUG [RS:2;jenkins-hbase17:35687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2583e5ca to 127.0.0.1:61257 2023-07-12 14:39:08,254 DEBUG [RS:2;jenkins-hbase17:35687] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,252 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(3305): Received CLOSE for 0ebccd86b5445c4071777db1be472c93 2023-07-12 14:39:08,258 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:39:08,259 DEBUG [RS:0;jenkins-hbase17:36691] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62f1e446 to 127.0.0.1:61257 2023-07-12 14:39:08,257 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35263,1689172568285; all regions closed. 2023-07-12 14:39:08,258 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35687,1689172568342; all regions closed. 2023-07-12 14:39:08,257 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 14:39:08,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e6dffbe3a8c5917c633c069e9f059453, disabling compactions & flushes 2023-07-12 14:39:08,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:39:08,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:39:08,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. after waiting 0 ms 2023-07-12 14:39:08,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:39:08,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e6dffbe3a8c5917c633c069e9f059453 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 14:39:08,259 DEBUG [RS:0;jenkins-hbase17:36691] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,273 INFO [RS:0;jenkins-hbase17:36691] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 14:39:08,273 INFO [RS:0;jenkins-hbase17:36691] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 14:39:08,273 INFO [RS:0;jenkins-hbase17:36691] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 14:39:08,273 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 14:39:08,276 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 14:39:08,281 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 14:39:08,285 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-12 14:39:08,286 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1478): Online Regions={e6dffbe3a8c5917c633c069e9f059453=hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453., 1588230740=hbase:meta,,1.1588230740, 0ebccd86b5445c4071777db1be472c93=hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93.} 2023-07-12 14:39:08,287 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1504): Waiting on 0ebccd86b5445c4071777db1be472c93, 1588230740, e6dffbe3a8c5917c633c069e9f059453 2023-07-12 14:39:08,288 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 14:39:08,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 14:39:08,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 14:39:08,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 14:39:08,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 14:39:08,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 14:39:08,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-12 14:39:08,392 DEBUG [RS:2;jenkins-hbase17:35687] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs 2023-07-12 14:39:08,392 INFO [RS:2;jenkins-hbase17:35687] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35687%2C1689172568342:(num 1689172570913) 2023-07-12 14:39:08,392 DEBUG [RS:2;jenkins-hbase17:35687] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,392 INFO [RS:2;jenkins-hbase17:35687] regionserver.LeaseManager(133): Closed leases 2023-07-12 14:39:08,393 DEBUG [RS:1;jenkins-hbase17:35263] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs 2023-07-12 14:39:08,393 INFO [RS:1;jenkins-hbase17:35263] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35263%2C1689172568285:(num 1689172570903) 2023-07-12 14:39:08,393 DEBUG [RS:1;jenkins-hbase17:35263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,393 INFO [RS:1;jenkins-hbase17:35263] regionserver.LeaseManager(133): Closed leases 2023-07-12 14:39:08,396 INFO [RS:2;jenkins-hbase17:35687] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 14:39:08,396 INFO [RS:2;jenkins-hbase17:35687] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 14:39:08,396 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 14:39:08,396 INFO [RS:2;jenkins-hbase17:35687] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 14:39:08,396 INFO [RS:2;jenkins-hbase17:35687] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 14:39:08,396 INFO [RS:1;jenkins-hbase17:35263] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 14:39:08,400 INFO [RS:1;jenkins-hbase17:35263] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 14:39:08,400 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 14:39:08,400 INFO [RS:1;jenkins-hbase17:35263] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 14:39:08,400 INFO [RS:1;jenkins-hbase17:35263] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 14:39:08,401 INFO [RS:1;jenkins-hbase17:35263] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35263 2023-07-12 14:39:08,401 INFO [RS:2;jenkins-hbase17:35687] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35687 2023-07-12 14:39:08,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/.tmp/info/4041a12ac5ed4510bb0f091efcd5e6a4 2023-07-12 14:39:08,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/.tmp/info/c25191ec40ea43a591b888eb53ff711c 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35687,1689172568342 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:39:08,412 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35263,1689172568285 2023-07-12 14:39:08,414 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,35687,1689172568342] 2023-07-12 14:39:08,416 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,35687,1689172568342; numProcessing=1 2023-07-12 14:39:08,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/.tmp/info/4041a12ac5ed4510bb0f091efcd5e6a4 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/info/4041a12ac5ed4510bb0f091efcd5e6a4 2023-07-12 14:39:08,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/info/4041a12ac5ed4510bb0f091efcd5e6a4, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 14:39:08,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c25191ec40ea43a591b888eb53ff711c 2023-07-12 14:39:08,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e6dffbe3a8c5917c633c069e9f059453 in 167ms, sequenceid=6, compaction requested=false 2023-07-12 14:39:08,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/namespace/e6dffbe3a8c5917c633c069e9f059453/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 14:39:08,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:39:08,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e6dffbe3a8c5917c633c069e9f059453: 2023-07-12 14:39:08,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689172571506.e6dffbe3a8c5917c633c069e9f059453. 2023-07-12 14:39:08,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0ebccd86b5445c4071777db1be472c93, disabling compactions & flushes 2023-07-12 14:39:08,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:39:08,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:39:08,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. after waiting 0 ms 2023-07-12 14:39:08,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:39:08,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 0ebccd86b5445c4071777db1be472c93 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 14:39:08,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/.tmp/rep_barrier/5bb5410dcb6845dda5ed0b17cd4554d2 2023-07-12 14:39:08,469 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5bb5410dcb6845dda5ed0b17cd4554d2 2023-07-12 14:39:08,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/.tmp/l/f663f103c3e844f997b22e6b528a9bb1 2023-07-12 14:39:08,487 DEBUG [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1504): Waiting on 0ebccd86b5445c4071777db1be472c93, 1588230740 2023-07-12 14:39:08,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f663f103c3e844f997b22e6b528a9bb1 2023-07-12 14:39:08,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/.tmp/l/f663f103c3e844f997b22e6b528a9bb1 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/l/f663f103c3e844f997b22e6b528a9bb1 2023-07-12 14:39:08,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f663f103c3e844f997b22e6b528a9bb1 2023-07-12 14:39:08,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/l/f663f103c3e844f997b22e6b528a9bb1, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 14:39:08,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0ebccd86b5445c4071777db1be472c93 in 63ms, sequenceid=18, compaction requested=false 2023-07-12 14:39:08,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/.tmp/table/b81fba3da7ae4b259c6108de2af00408 2023-07-12 14:39:08,515 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,515 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35687-0x10159f559c10003, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,515 INFO [RS:2;jenkins-hbase17:35687] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35687,1689172568342; zookeeper connection closed. 2023-07-12 14:39:08,516 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,35687,1689172568342 already deleted, retry=false 2023-07-12 14:39:08,516 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,35687,1689172568342 expired; onlineServers=2 2023-07-12 14:39:08,516 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@182f2ab5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@182f2ab5 2023-07-12 14:39:08,516 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,35263,1689172568285] 2023-07-12 14:39:08,516 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,35263,1689172568285; numProcessing=2 2023-07-12 14:39:08,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/acl/0ebccd86b5445c4071777db1be472c93/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 14:39:08,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:39:08,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0ebccd86b5445c4071777db1be472c93: 2023-07-12 14:39:08,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689172572381.0ebccd86b5445c4071777db1be472c93. 2023-07-12 14:39:08,525 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b81fba3da7ae4b259c6108de2af00408 2023-07-12 14:39:08,526 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/.tmp/info/c25191ec40ea43a591b888eb53ff711c as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/info/c25191ec40ea43a591b888eb53ff711c 2023-07-12 14:39:08,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c25191ec40ea43a591b888eb53ff711c 2023-07-12 14:39:08,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/info/c25191ec40ea43a591b888eb53ff711c, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 14:39:08,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/.tmp/rep_barrier/5bb5410dcb6845dda5ed0b17cd4554d2 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/rep_barrier/5bb5410dcb6845dda5ed0b17cd4554d2 2023-07-12 14:39:08,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5bb5410dcb6845dda5ed0b17cd4554d2 2023-07-12 14:39:08,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/rep_barrier/5bb5410dcb6845dda5ed0b17cd4554d2, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 14:39:08,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/.tmp/table/b81fba3da7ae4b259c6108de2af00408 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/table/b81fba3da7ae4b259c6108de2af00408 2023-07-12 14:39:08,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b81fba3da7ae4b259c6108de2af00408 2023-07-12 14:39:08,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/table/b81fba3da7ae4b259c6108de2af00408, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 14:39:08,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 207ms, sequenceid=131, compaction requested=false 2023-07-12 14:39:08,609 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 14:39:08,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 14:39:08,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 14:39:08,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 14:39:08,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 14:39:08,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 14:39:08,615 INFO [RS:1;jenkins-hbase17:35263] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35263,1689172568285; zookeeper connection closed. 2023-07-12 14:39:08,615 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,616 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:35263-0x10159f559c10002, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,616 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,35263,1689172568285 already deleted, retry=false 2023-07-12 14:39:08,616 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,35263,1689172568285 expired; onlineServers=1 2023-07-12 14:39:08,621 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d1862a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d1862a6 2023-07-12 14:39:08,687 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,36691,1689172568228; all regions closed. 2023-07-12 14:39:08,721 DEBUG [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs 2023-07-12 14:39:08,721 INFO [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C36691%2C1689172568228.meta:.meta(num 1689172571158) 2023-07-12 14:39:08,754 DEBUG [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/oldWALs 2023-07-12 14:39:08,754 INFO [RS:0;jenkins-hbase17:36691] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C36691%2C1689172568228:(num 1689172570895) 2023-07-12 14:39:08,754 DEBUG [RS:0;jenkins-hbase17:36691] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,754 INFO [RS:0;jenkins-hbase17:36691] regionserver.LeaseManager(133): Closed leases 2023-07-12 14:39:08,755 INFO [RS:0;jenkins-hbase17:36691] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 14:39:08,755 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 14:39:08,756 INFO [RS:0;jenkins-hbase17:36691] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:36691 2023-07-12 14:39:08,757 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 14:39:08,757 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36691,1689172568228 2023-07-12 14:39:08,759 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,36691,1689172568228] 2023-07-12 14:39:08,759 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,36691,1689172568228; numProcessing=3 2023-07-12 14:39:08,760 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,36691,1689172568228 already deleted, retry=false 2023-07-12 14:39:08,760 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,36691,1689172568228 expired; onlineServers=0 2023-07-12 14:39:08,760 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35815,1689172566719' ***** 2023-07-12 14:39:08,760 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 14:39:08,760 DEBUG [M:0;jenkins-hbase17:35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f8e4ca8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-12 14:39:08,761 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35815,1689172566719 2023-07-12 14:39:08,761 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35815,1689172566719; all regions closed. 2023-07-12 14:39:08,761 DEBUG [M:0;jenkins-hbase17:35815] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 14:39:08,761 DEBUG [M:0;jenkins-hbase17:35815] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 14:39:08,761 DEBUG [M:0;jenkins-hbase17:35815] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 14:39:08,761 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689172570289] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689172570289,5,FailOnTimeoutGroup] 2023-07-12 14:39:08,761 INFO [M:0;jenkins-hbase17:35815] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 14:39:08,761 INFO [M:0;jenkins-hbase17:35815] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 14:39:08,761 INFO [M:0;jenkins-hbase17:35815] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-12 14:39:08,762 DEBUG [M:0;jenkins-hbase17:35815] master.HMaster(1512): Stopping service threads 2023-07-12 14:39:08,762 INFO [M:0;jenkins-hbase17:35815] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 14:39:08,763 INFO [M:0;jenkins-hbase17:35815] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 14:39:08,764 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 14:39:08,764 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 14:39:08,764 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 14:39:08,764 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689172570288] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689172570288,5,FailOnTimeoutGroup] 2023-07-12 14:39:08,764 DEBUG [M:0;jenkins-hbase17:35815] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-12 14:39:08,765 DEBUG [M:0;jenkins-hbase17:35815] master.ActiveMasterManager(335): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-12 14:39:08,765 INFO [M:0;jenkins-hbase17:35815] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 14:39:08,765 INFO [M:0;jenkins-hbase17:35815] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 14:39:08,766 DEBUG [M:0;jenkins-hbase17:35815] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 14:39:08,766 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:39:08,766 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 14:39:08,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 14:39:08,766 DEBUG [M:0;jenkins-hbase17:35815] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:39:08,766 DEBUG [M:0;jenkins-hbase17:35815] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 14:39:08,766 DEBUG [M:0;jenkins-hbase17:35815] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:39:08,766 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.01 KB heapSize=452.20 KB 2023-07-12 14:39:08,852 INFO [M:0;jenkins-hbase17:35815] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.01 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cfb091093f4545a89826fe55b98c3b76 2023-07-12 14:39:08,855 INFO [M:0;jenkins-hbase17:35815] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfb091093f4545a89826fe55b98c3b76 2023-07-12 14:39:08,856 DEBUG [M:0;jenkins-hbase17:35815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cfb091093f4545a89826fe55b98c3b76 as hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cfb091093f4545a89826fe55b98c3b76 2023-07-12 14:39:08,859 INFO [M:0;jenkins-hbase17:35815] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfb091093f4545a89826fe55b98c3b76 2023-07-12 14:39:08,860 INFO [M:0;jenkins-hbase17:35815] regionserver.HStore(1080): Added hdfs://localhost.localdomain:36845/user/jenkins/test-data/581e7b0c-1d5e-6339-640c-ffd802f0e8d9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cfb091093f4545a89826fe55b98c3b76, entries=119, sequenceid=899, filesize=28.6 K 2023-07-12 14:39:08,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,860 INFO [RS:0;jenkins-hbase17:36691] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,36691,1689172568228; zookeeper connection closed. 2023-07-12 14:39:08,860 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): regionserver:36691-0x10159f559c10001, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,860 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@25ac0627] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@25ac0627 2023-07-12 14:39:08,860 INFO [Listener at jenkins-hbase17.apache.org/34087] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 14:39:08,861 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegion(2948): Finished flush of dataSize ~376.01 KB/385034, heapSize ~452.19 KB/463040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 95ms, sequenceid=899, compaction requested=false 2023-07-12 14:39:08,869 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 14:39:08,869 DEBUG [M:0;jenkins-hbase17:35815] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 14:39:08,883 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 14:39:08,883 INFO [M:0;jenkins-hbase17:35815] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 14:39:08,884 INFO [M:0;jenkins-hbase17:35815] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35815 2023-07-12 14:39:08,886 DEBUG [M:0;jenkins-hbase17:35815] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,35815,1689172566719 already deleted, retry=false 2023-07-12 14:39:08,989 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,989 DEBUG [Listener at localhost.localdomain/40419-EventThread] zookeeper.ZKWatcher(600): master:35815-0x10159f559c10000, quorum=127.0.0.1:61257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 14:39:08,989 INFO [M:0;jenkins-hbase17:35815] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35815,1689172566719; zookeeper connection closed. 2023-07-12 14:39:08,991 WARN [Listener at jenkins-hbase17.apache.org/34087] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 14:39:09,026 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 14:39:09,133 WARN [BP-891311939-136.243.18.41-1689172562208 heartbeating to localhost.localdomain/127.0.0.1:36845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 14:39:09,133 WARN [BP-891311939-136.243.18.41-1689172562208 heartbeating to localhost.localdomain/127.0.0.1:36845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891311939-136.243.18.41-1689172562208 (Datanode Uuid 02200306-68d2-4e47-99a2-5f3f0e8af6bc) service to localhost.localdomain/127.0.0.1:36845 2023-07-12 14:39:09,135 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data5/current/BP-891311939-136.243.18.41-1689172562208] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 14:39:09,136 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data6/current/BP-891311939-136.243.18.41-1689172562208] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 14:39:09,138 WARN [Listener at jenkins-hbase17.apache.org/34087] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 14:39:09,154 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 14:39:09,258 WARN [BP-891311939-136.243.18.41-1689172562208 heartbeating to localhost.localdomain/127.0.0.1:36845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 14:39:09,258 WARN [BP-891311939-136.243.18.41-1689172562208 heartbeating to localhost.localdomain/127.0.0.1:36845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891311939-136.243.18.41-1689172562208 (Datanode Uuid 9a9c268d-88e0-4bc1-a254-3277b28b8ad0) service to localhost.localdomain/127.0.0.1:36845 2023-07-12 14:39:09,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data3/current/BP-891311939-136.243.18.41-1689172562208] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 14:39:09,259 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data4/current/BP-891311939-136.243.18.41-1689172562208] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 14:39:09,265 WARN [Listener at jenkins-hbase17.apache.org/34087] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 14:39:09,274 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 14:39:09,378 WARN [BP-891311939-136.243.18.41-1689172562208 heartbeating to localhost.localdomain/127.0.0.1:36845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 14:39:09,378 WARN [BP-891311939-136.243.18.41-1689172562208 heartbeating to localhost.localdomain/127.0.0.1:36845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891311939-136.243.18.41-1689172562208 (Datanode Uuid f72d87d5-ee99-48d6-b1b3-dc081a94ff4f) service to localhost.localdomain/127.0.0.1:36845 2023-07-12 14:39:09,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data1/current/BP-891311939-136.243.18.41-1689172562208] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 14:39:09,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/964ec33c-9a1e-7a2d-0918-26c24b90a9c2/cluster_ca79db21-4945-b6fb-2fbb-76c668108303/dfs/data/data2/current/BP-891311939-136.243.18.41-1689172562208] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 14:39:09,421 INFO [Listener at jenkins-hbase17.apache.org/34087] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 14:39:09,467 INFO [Listener at jenkins-hbase17.apache.org/34087] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 14:39:09,633 INFO [Listener at jenkins-hbase17.apache.org/34087] hbase.HBaseTestingUtility(1293): Minicluster is down